-- Logs begin at Sun 2022-09-25 00:10:28 UTC, end at Sun 2022-09-25 01:17:40 UTC. -- Sep 25 00:47:11.880248 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@q-agt.service. Sep 25 00:47:14.487594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.common.config [-] Logging enabled! Sep 25 00:47:14.488438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.common.config [-] /usr/local/bin/neutron-openvswitch-agent version 21.1.0.dev21 Sep 25 00:47:14.488979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-openvswitch-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=107261) setup_logging /opt/stack/neutron/neutron/common/config.py:123}} Sep 25 00:47:14.489469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO os_ken.base.app_manager [-] loading app neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_oskenapp Sep 25 00:47:14.966351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO keyring.backend [-] Loading KWallet Sep 25 00:47:14.974010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO keyring.backend [-] Loading SecretService Sep 25 00:47:14.977771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO keyring.backend [-] Loading Windows Sep 25 00:47:14.979108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO keyring.backend [-] Loading chainer Sep 25 00:47:14.979890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO keyring.backend [-] Loading macOS Sep 25 00:47:15.603738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:15.604815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:15.605234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:15.606804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:15.607071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:15.607334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:15.665807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:15.666444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:15.671032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:15.679116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:15.679609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:15.680105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:15.707188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:15.707937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:15.708404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:15.753481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:15.754524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:15.754957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:15.972504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO os_ken.base.app_manager [-] loading app os_ken.app.ofctl.service Sep 25 00:47:15.973794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO os_ken.base.app_manager [-] loading app os_ken.controller.ofp_handler Sep 25 00:47:15.976962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO os_ken.base.app_manager [-] instantiating app neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_oskenapp of OVSNeutronAgentOSKenApp Sep 25 00:47:15.976962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO os_ken.base.app_manager [-] instantiating app os_ken.app.ofctl.service of OfctlService Sep 25 00:47:15.976962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO os_ken.base.app_manager [-] instantiating app os_ken.controller.ofp_handler of OFPHandler Sep 25 00:47:15.979943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: Open vSwitch agent after_init 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:15.980622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.agent_extensions_manager [-] Loaded agent extensions: [] Sep 25 00:47:15.980990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ******************************************************************************** {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 25 00:47:15.981277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] Configuration options gathered from: {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 25 00:47:15.981577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 25 00:47:15.981937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 25 00:47:15.982183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ================================================================================ {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 25 00:47:15.982541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] agent_down_time = 75 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.982861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] allow_bulk = True {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.983191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] api_extensions_path = {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.983517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] api_paste_config = api-paste.ini {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.987225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] auth_strategy = keystone {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.987225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] backlog = 4096 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.987225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] base_mac = fa:16:3e:00:00:00 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.987225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] bind_host = 0.0.0.0 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.987225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] bind_port = 9696 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.987225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] client_socket_timeout = 900 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.987225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] config_dir = [] {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.987692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.987692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] config_source = [] {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.987692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] control_exchange = neutron {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.987692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] core_plugin = ml2 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.987692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] debug = True {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.987692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] default_availability_zones = [] {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.988053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.988053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] dhcp_agent_notification = True {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.988213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] dhcp_lease_duration = 86400 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.988592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] dhcp_load_type = networks {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.988592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] dns_domain = openstacklocal {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.988882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] enable_new_agents = True {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.989023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] enable_traditional_dhcp = True {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.989349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] external_dns_driver = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.989534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] filter_validation = True {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.989786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] global_physnet_mtu = 1500 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.990158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] host = dv-cinder-master-3-iscsi {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.990357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] http_retries = 3 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.990609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] instance_format = [instance: %(uuid)s] {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.990861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.991113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ipam_driver = internal {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.991356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ipv6_pd_enabled = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.991601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_config_append = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.991860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.992100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_dir = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.992340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_file = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.992675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_rotate_interval = 1 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.992971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_rotate_interval_type = days {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.993234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_rotation_type = none {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.993507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.993734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.993900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.994059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.994420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.994670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_dns_nameservers = 5 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.994910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_header_line = 16384 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.995153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_logfile_count = 30 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.995394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_logfile_size_mb = 200 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.995632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_subnet_host_routes = 20 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.995866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] network_link_prefix = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.996119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] notify_nova_on_port_data_changes = True {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.996370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] notify_nova_on_port_status_changes = True {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.996621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] pagination_max_limit = -1 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.996858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] publish_errors = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.997096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rate_limit_burst = 0 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.997383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rate_limit_except_level = CRITICAL {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.997626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rate_limit_interval = 0 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.997865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] retry_until_window = 30 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.998106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rpc_resources_processing_step = 20 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.998343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rpc_response_max_timeout = 600 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.998580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] send_events_interval = 2 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.998852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.999103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] setproctitle = on {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.999351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] state_path = /opt/stack/data/neutron {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.999602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] syslog_log_facility = LOG_USER {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:15.999841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] tcp_keepidle = 600 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:16.000090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] transport_url = **** {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:16.000327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_eventlog = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:16.000562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_journal = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:16.000803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_json = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:16.001039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_ssl = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:16.001286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_stderr = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:16.001541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_syslog = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:16.001779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] vlan_transparent = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:16.002019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] watch_log_file = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:16.002258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] wsgi_default_pool_size = 100 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:16.002494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] wsgi_keep_alive = True {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:16.002745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:16.003045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] wsgi_server_debug = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:47:16.003239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_concurrency.disable_process_locking = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.003542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.003767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.connection_string = messaging:// {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.004023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.enabled = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.004279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.es_doc_type = notification {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.004662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.es_scroll_size = 10000 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.004922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.es_scroll_time = 2m {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.005163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.filter_error_trace = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.005437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.hmac_keys = SECRET_KEY {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.005689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.sentinel_service_name = mymaster {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.005949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.socket_timeout = 0.1 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.006190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.trace_sqlalchemy = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.006456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.enforce_new_defaults = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.006709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.enforce_scope = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.006969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.policy_default_rule = default {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.007244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.007501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.007756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.007995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.008265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.008507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.008739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.008993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.009237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.009507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_process_name = {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.009758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.009999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.010261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.010517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.arp_responder = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.010757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.baremetal_smartnic = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.011001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.dont_fragment = True {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.011243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.drop_flows_on_start = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.011480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.dscp = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.011721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.dscp_inherit = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.011969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.enable_distributed_routing = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.012208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.explicitly_egress_direct = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.012450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.l2_population = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.012691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.log_agent_heartbeats = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.012930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.minimize_polling = True {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.013173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.ovsdb_monitor_respawn_interval = 30 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.013435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.polling_interval = 2 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.013674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.quitting_rpc_timeout = 10 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.013985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.report_interval = 30.0 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.014245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.014501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.014882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.tunnel_csum = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.015142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.tunnel_types = [] {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.015386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.use_helper_for_ns_read = True {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.015628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.veth_mtu = 9000 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.015872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.vxlan_udp_port = 4789 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.016131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.bridge_mac_table_size = 50000 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.016396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.bridge_mappings = ['physnet1:br-data'] {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.016653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.datapath_type = system {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.016892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.igmp_snooping_enable = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.017143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.int_peer_patch_port = patch-tun {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.017423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.integration_bridge = br-int {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.017665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.local_ip = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.017906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_connect_timeout = 300 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.018145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_inactivity_probe = 10 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.018408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_listen_address = 127.0.0.1 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.018653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_listen_port = 6633 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.018892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_request_timeout = 300 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.019132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.openflow_processed_per_port = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.019381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ovsdb_connection = tcp:127.0.0.1:6640 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.019623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ovsdb_debug = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.019861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ovsdb_timeout = 10 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.020170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_bandwidths = [] {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.020580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_default_hypervisor = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.021007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_hypervisors = {} {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.021521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_inventory_defaults = {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0} {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.021861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_packet_processing_inventory_defaults = {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0} {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.022117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_packet_processing_with_direction = [] {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.022369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_packet_processing_without_direction = [] {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.022612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ssl_ca_cert_file = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.022857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ssl_cert_file = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.023098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ssl_key_file = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.023356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.tun_peer_patch_port = patch-int {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.023612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.tunnel_bridge = br-tun {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.024542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.vhostuser_socket_dir = /var/run/openvswitch {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.024966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] DHCP.dhcp_rebinding_time = 0 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.025213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] DHCP.dhcp_renewal_time = 0 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.025674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] DHCP.enable_ipv6 = True {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.025934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] LOCAL_IP.static_nat = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.026190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.auth_section = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.026456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.auth_type = password {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.026714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.026957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.certfile = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.027199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.collect_timing = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.027462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.endpoint_type = public {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.027705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.insecure = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.027941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.keyfile = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.028197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.region_name = RegionOne {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.028440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.split_loggers = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.028679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.timeout = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.028924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.auth_section = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.029180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.auth_type = password {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.029478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.029718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.certfile = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.029958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.collect_timing = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.030216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.endpoint_type = public {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.030455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.insecure = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.030691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.keyfile = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.030941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.region_name = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.031158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.split_loggers = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.031391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.timeout = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.031638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.auth_section = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.031877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.auth_type = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.032116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.cafile = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.032353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.certfile = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.032591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.collect_timing = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.032825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.connect_retries = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.033060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.connect_retry_delay = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.033318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.enable_notifications = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.033556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.endpoint_override = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.033795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.insecure = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.034029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.interface = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.034264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.keyfile = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.034499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.max_version = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.034734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.min_version = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.035103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.region_name = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.035343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.service_name = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.035578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.service_type = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.035813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.split_loggers = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.036048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.status_code_retries = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.036281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.status_code_retry_delay = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.036514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.timeout = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.036748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.valid_interfaces = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.036981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.version = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.037231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] cli_script.dry_run = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.037533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.037777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.038021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.038261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.038503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.038746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.038986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.039226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.040026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.040283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.040733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.041065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.041437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.041691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.041935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.042198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.042444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.042688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.042930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.043173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.043411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.043656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.043897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.044144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.044390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.044640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.044900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.045344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.045597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.045855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.046115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_version = {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.046375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_notifications.driver = [] {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.046618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_notifications.retry = -1 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.046893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.047134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_notifications.transport_url = **** {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.047392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.047631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.group = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.047866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.helper_command = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.048111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.logger_name = oslo_privsep.daemon {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.048352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.thread_pool_size = 4 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.048586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.user = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.048833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.049069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.group = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.049321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.helper_command = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.049568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.049807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.050040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.user = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.050290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.050521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.group = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.050753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.helper_command = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.050996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.051233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.051466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.user = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.051710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.capabilities = [21] {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.051942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.group = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.052180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.helper_command = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.052423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.052661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.thread_pool_size = 4 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.052897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.user = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.053143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.capabilities = [12] {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.053450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.group = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.053687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.helper_command = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.053985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.054234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.thread_pool_size = 4 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.054470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.user = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.054720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.capabilities = [12, 21] {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.054984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.group = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.055366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.helper_command = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.055781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.056028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.thread_pool_size = 4 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.056258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.user = None {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.056493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] service_providers.service_provider = [] {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.056741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.056935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] agent.extensions = [] {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.057188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.default_quota = -1 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.057471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.057728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_network = 100 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.057983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_port = 500 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.058231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_rbac_policy = 10 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.058486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_security_group = 100 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.058733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_security_group_rule = 100 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.058990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_subnet = 100 {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.059232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.track_quota_usage = True {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.059481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] SECURITYGROUP.enable_ipset = True {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.059734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] SECURITYGROUP.enable_security_group = True {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.059987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.060234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:47:16.060414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ******************************************************************************** {{(pid=107261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 25 00:47:16.113206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Flow_Table.name {{(pid=107261) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:85}} Sep 25 00:47:16.113441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Mirror.name {{(pid=107261) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:85}} Sep 25 00:47:16.113670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Bridge.name {{(pid=107261) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:104}} Sep 25 00:47:16.113896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Port.name {{(pid=107261) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:104}} Sep 25 00:47:16.114157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Interface.name {{(pid=107261) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:104}} Sep 25 00:47:16.114397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Manager.target {{(pid=107261) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:104}} Sep 25 00:47:16.193720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(name=br-int, may_exist=True, datapath_type=system) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:47:16.194129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbAddCommand(table=Bridge, record=br-int, column=protocols, values=('OpenFlow10', 'OpenFlow14', 'OpenFlow13')) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:47:16.194849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(table=Bridge, record=br-int, col_values=(('other_config', {'mac-table-size': '50000'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:47:16.201022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): SetFailModeCommand(bridge=br-int, mode=secure) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:47:16.206406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_bridge [-] Setting controller tcp:127.0.0.1:6633 for bridge br-int. {{(pid=107261) setup_controllers /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ovs_bridge.py:80}} Sep 25 00:47:16.207157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): SetControllerCommand(bridge=br-int, targets=['tcp:127.0.0.1:6633']) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:47:17.232507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Controller, record=f78b9e15-351b-4b66-87ff-0d47f7e03d2c, col_values=(('connection_mode', 'out-of-band'),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:47:17.248385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Controller, record=f78b9e15-351b-4b66-87ff-0d47f7e03d2c, col_values=(('inactivity_probe', 10000),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:47:17.256229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Bridge, record=br-int, col_values=(('mcast_snooping_enable', False),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:47:17.257031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(table=Bridge, record=br-int, col_values=(('other_config', {'mcast-snooping-disable-flood-unregistered': 'false'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:47:17.271360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_bridge [-] Bridge br-int has datapath-ID 00002a52d7509841 Sep 25 00:47:17.275504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x38,xid=0x5f17b13e,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=23) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:17.278590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5f17b140,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:17.281456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5f17b142,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=60,type=1)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=59) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:17.285216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x50,xid=0x5f17b144,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=3,table_id=60) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:17.288179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x38,xid=0x5f17b146,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=24) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:17.291418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5f17b148,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'vlan_vid': 8191}),out_group=0,out_port=0,priority=65535,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:17.296831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x50,xid=0x5f17b14a,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=3,table_id=62) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:17.304493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5f17b14c,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=30) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:17.304493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5f17b14e,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=31) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:17.304493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.utils [-] Std library socket module is patched by eventlet. Requesting std library socket module from eventlet. {{(pid=107261) __init__ /opt/stack/neutron/neutron/agent/common/utils.py:91}} Sep 25 00:47:17.304493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] Mapping physical network physnet1 to bridge br-data Sep 25 00:47:17.304493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] Bridge br-data datapath-id = 0x00000a61947ebe48 Sep 25 00:47:17.305488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(name=br-data, may_exist=True, datapath_type=system) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:47:17.305751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbAddCommand(table=Bridge, record=br-data, column=protocols, values=('OpenFlow10', 'OpenFlow14', 'OpenFlow13')) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:47:17.306811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(table=Bridge, record=br-data, col_values=(('other_config', {'mac-table-size': '50000'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:47:17.320322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): SetFailModeCommand(bridge=br-data, mode=secure) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:47:17.328232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_bridge [-] Setting controller tcp:127.0.0.1:6633 for bridge br-data. {{(pid=107261) setup_controllers /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ovs_bridge.py:80}} Sep 25 00:47:17.328799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): SetControllerCommand(bridge=br-data, targets=['tcp:127.0.0.1:6633']) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:47:18.347748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Controller, record=9c891361-be6c-44bd-9c59-bb5915c15de8, col_values=(('connection_mode', 'out-of-band'),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:47:18.356703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Controller, record=9c891361-be6c-44bd-9c59-bb5915c15de8, col_values=(('inactivity_probe', 10000),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:47:18.367376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_bridge [-] Bridge br-data has datapath-ID 00000a61947ebe48 Sep 25 00:47:18.370932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x50,xid=0xa5d7ab2a,OFPFlowMod(buffer_id=4294967295,command=0,cookie=13979250796582379444,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:18.372006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(bridge=br-int, port=int-br-data, may_exist=True) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:47:18.373102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(table=Interface, record=int-br-data, col_values=(('type', 'patch'), ('options', {'peer': 'nonexistent-peer'}))) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:47:18.399828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=int-br-data, col_values=(('other_config', {'mcast-snooping-flood-reports': 'False', 'mcast-snooping-flood': 'False'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:47:18.416893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(bridge=br-data, port=phy-br-data, may_exist=True) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:47:18.418311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(table=Interface, record=phy-br-data, col_values=(('type', 'patch'), ('options', {'peer': 'nonexistent-peer'}))) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:47:18.436100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x5f17b150,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:18.438597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xa5d7ab2c,OFPFlowMod(buffer_id=4294967295,command=0,cookie=13979250796582379444,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:18.439504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Interface, record=int-br-data, col_values=(('options', {'peer': 'phy-br-data'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:47:18.451840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Interface, record=phy-br-data, col_values=(('options', {'peer': 'int-br-data'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:47:18.464770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for Port {{(pid=107261) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 25 00:47:18.470726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for SecurityGroup {{(pid=107261) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 25 00:47:18.472106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for SecurityGroupRule {{(pid=107261) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 25 00:47:18.473081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for Network {{(pid=107261) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 25 00:47:18.474310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for Subnet {{(pid=107261) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 25 00:47:18.475289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for AddressGroup {{(pid=107261) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 25 00:47:18.696648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > Port after_update 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:18.697154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > Network after_update 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:18.697683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > Port after_delete 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:18.698055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > Network after_delete 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:18.698565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > SecurityGroup after_delete 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:18.698954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > SecurityGroup after_update 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:18.771444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Init firewall settings (driver=openvswitch) {{(pid=107261) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:121}} Sep 25 00:47:18.772658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbAddCommand(table=Bridge, record=br-int, column=protocols, values=('OpenFlow12', 'OpenFlow11')) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:47:19.782840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc41,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=71,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:19.785294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc43,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=72,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:19.788661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc45,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=73,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:19.791702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc47,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=81,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:19.794748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc49,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=82,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:19.795436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.ip_conntrack [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Starting ip_conntrack _process_queue_worker() threads {{(pid=107261) _start_process_queue /opt/stack/neutron/neutron/agent/linux/ip_conntrack.py:80}} Sep 25 00:47:19.796020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Processing 1 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:47:19.797476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO oslo.privsep.daemon [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Running privsep helper: ['sudo', '/usr/local/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--privsep_context', 'neutron.privileged.default', '--privsep_sock_path', '/tmp/tmpnz7cc238/privsep.sock'] Sep 25 00:47:19.814394 dv-cinder-master-3-iscsi sudo[108952]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --privsep_context neutron.privileged.default --privsep_sock_path /tmp/tmpnz7cc238/privsep.sock Sep 25 00:47:19.815723 dv-cinder-master-3-iscsi sudo[108952]: pam_unix(sudo:session): session opened for user root by (uid=0) Sep 25 00:47:21.254696 dv-cinder-master-3-iscsi sudo[108952]: pam_unix(sudo:session): session closed for user root Sep 25 00:47:21.265032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO oslo.privsep.daemon [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Spawned new privsep daemon via rootwrap Sep 25 00:47:21.265770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Accepted privsep connection to /tmp/tmpnz7cc238/privsep.sock {{(pid=107261) __init__ /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:362}} Sep 25 00:47:21.266844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 25 00:47:21.267115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 25 00:47:21.267346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN|CAP_SYS_PTRACE/CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN|CAP_SYS_PTRACE/none Sep 25 00:47:21.267608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 108960 Sep 25 00:47:21.270473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[925b6039-ca36-4faa-9182-40f856f492cb]: (2,) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:47:21.883646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "context-manager" by "neutron_lib.db.api._create_context_manager" {{(pid=108960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 00:47:21.884570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo_concurrency.lockutils [-] Lock "context-manager" acquired by "neutron_lib.db.api._create_context_manager" :: waited 0.000s {{(pid=108960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 00:47:21.885051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo_concurrency.lockutils [-] Lock "context-manager" "released" by "neutron_lib.db.api._create_context_manager" :: held 0.000s {{(pid=108960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 00:47:22.113542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44ca81b-3644-42cd-939a-e971c0847c27]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:47:22.114531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Processing 1 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:47:22.126136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b898a0-79db-4bc6-9b3a-66eb7bbddd48]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:47:22.126804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Processing 1 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:47:22.137561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[add9c571-6d84-4927-9178-ac0f42d0012f]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:47:22.138219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Processing 1 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:47:22.148124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[83df350d-48fa-4fa9-ae6d-288dd55680da]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:47:22.148983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Processing 1 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:47:22.159378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd5db9b-341c-4b9c-8113-fa491cf06e8d]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:47:22.160128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Processing 1 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:47:22.170497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df356ed-33d4-4408-a6d4-dbdcf8d4809e]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:47:22.171416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Processing 1 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:47:22.181647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03bb0b6-7d1a-4c6f-88f9-c6280f2b290d]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:47:22.182477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Processing 1 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:47:22.193568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9980b68f-d040-4321-9dc4-3aaba2f6524a]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:47:22.194422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Processing 1 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:47:22.205090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc006782-0520-4a10-8323-1ccae1c1a6d2]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:47:22.205979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Processing 1 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:47:22.215691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12dbda0-535c-4d80-b3e4-e6dc336a3068]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:47:22.216445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Subscribe: > agent ovs_restarted 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:22.217299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Subscribe: > SecurityGroupRule after_delete 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:22.217590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Subscribe: > SecurityGroupRule after_update 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:22.218010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Subscribe: > Port after_delete 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:22.218424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Subscribe: > Port after_update 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:22.218829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Subscribe: > AddressGroup after_update 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:22.219267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Subscribe: > AddressGroup after_delete 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:22.302294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.driver.init_handler-8738462637285'] for Open vSwitch agent (None), after_init {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:47:22.303549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Subscribe: > ovsdb after_read 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:22.305960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Subscribe: > Trunk before_create 55550000 {{(pid=107261) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 25 00:47:22.306581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.callbacks.resource_manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Registering callback for Trunk {{(pid=107261) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 25 00:47:22.306963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.callbacks.resource_manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Registering callback for SubPort {{(pid=107261) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 25 00:47:22.374725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.callbacks.resource_manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Unregistering callback for Trunk {{(pid=107261) unregister /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:72}} Sep 25 00:47:22.375361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent initialized successfully, now running... Sep 25 00:47:22.377972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO oslo.privsep.daemon [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Running privsep helper: ['sudo', '/usr/local/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--privsep_context', 'neutron.privileged.ovs_vsctl_cmd', '--privsep_sock_path', '/tmp/tmpcucchnzf/privsep.sock'] Sep 25 00:47:22.402676 dv-cinder-master-3-iscsi sudo[108976]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --privsep_context neutron.privileged.ovs_vsctl_cmd --privsep_sock_path /tmp/tmpcucchnzf/privsep.sock Sep 25 00:47:22.403494 dv-cinder-master-3-iscsi sudo[108976]: pam_unix(sudo:session): session opened for user root by (uid=0) Sep 25 00:47:23.699735 dv-cinder-master-3-iscsi sudo[108976]: pam_unix(sudo:session): session closed for user root Sep 25 00:47:23.705323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO oslo.privsep.daemon [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Spawned new privsep daemon via rootwrap Sep 25 00:47:23.705854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Accepted privsep connection to /tmp/tmpcucchnzf/privsep.sock {{(pid=107261) __init__ /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:362}} Sep 25 00:47:23.706870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 25 00:47:23.707131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 25 00:47:23.707385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 25 00:47:23.707631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109014 Sep 25 00:47:23.710313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bdc536-97a4-43cd-b701-dbfb1c42cf5e]: (2,) {{(pid=109014) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:47:23.933644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): ovs-vsctl --timeout=10 --id=@manager -- create Manager target="ptcp:6640:127.0.0.1" -- add Open_vSwitch . manager_options @manager -- set Manager ptcp:6640:127.0.0.1 inactivity_probe=10000 {{(pid=109014) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 25 00:47:23.940107 dv-cinder-master-3-iscsi ovs-vsctl[109018]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --timeout=10 --id=@manager -- create Manager "target=\"ptcp:6640:127.0.0.1\"" -- add Open_vSwitch . manager_options @manager -- set Manager ptcp:6640:127.0.0.1 inactivity_probe=10000 Sep 25 00:47:23.942978 dv-cinder-master-3-iscsi ovs-vsctl[109018]: ovs|00002|db_ctl_base|ERR|multiple rows in Manager match "ptcp:6640:127.0.0.1" Sep 25 00:47:23.944563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo_concurrency.processutils [-] CMD "ovs-vsctl --timeout=10 --id=@manager -- create Manager target="ptcp:6640:127.0.0.1" -- add Open_vSwitch . manager_options @manager -- set Manager ptcp:6640:127.0.0.1 inactivity_probe=10000" returned: 1 in 0.011s {{(pid=109014) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 25 00:47:23.944947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e40f5b-3658-49f9-b87e-f1b019d82b65]: (4, ('', 'ovs-vsctl: multiple rows in Manager match "ptcp:6640:127.0.0.1"\n')) {{(pid=109014) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:47:23.946271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Launching async process [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]. {{(pid=107261) start /opt/stack/neutron/neutron/agent/common/async_process.py:117}} Sep 25 00:47:23.946828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Running command: ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] {{(pid=107261) create_process /opt/stack/neutron/neutron/agent/linux/utils.py:84}} Sep 25 00:47:23.954267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:47:23.955005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:0 started Sep 25 00:47:23.960097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc4b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=685000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:23.962519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["2babd253-5394-452b-9620-8925ec31469b","initial","br-data",65534,["map",[]]],["cd0d7cc4-7e47-4e03-9da3-26b3c85be0d7","initial","int-br-data",1,["map",[]]],["5ca4c536-aeda-4278-ab0f-9bcad88074ca","initial","br-int",65534,["map",[]]],["b0df9704-cdb3-4105-9738-ffb3111afc1b","initial","phy-br-data",2,["map",[]]],["84560800-a33a-496f-badf-f868b868faec","initial","eth1",1,["map",[]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:47:23.963009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:47:23.963536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:0 - starting polling. Elapsed:0.009 Sep 25 00:47:23.964959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:47:23.965917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:0 - port information retrieved. Elapsed:0.011 Sep 25 00:47:23.966218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Cleaning stale br-int flows Sep 25 00:47:23.966558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Reserved cookies for br-int: {5543098084362340806} Sep 25 00:47:23.969967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc4d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=0,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=679000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=64,match=OFPMatch(oxm_fields={'vlan_vid': 8191}),packet_count=0,priority=65535,table_id=0), OFPFlowStats(byte_count=1000,cookie=5543098084362340806,duration_nsec=534000000,duration_sec=5,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=64,match=OFPMatch(oxm_fields={'in_port': 1}),packet_count=4,priority=2,table_id=0), OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=691000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],length=64,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=0)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:23.971827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc4f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=1,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:23.973648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc51,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=2,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:23.975654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc53,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=702000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:23.978391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc55,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=24,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=690000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=24)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:23.980201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc57,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=25,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:23.982032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc59,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=61,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:23.984154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc5b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=30,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=685000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],length=64,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=30)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:23.986567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc5d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=31,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=684000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],length=64,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=31)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:23.988872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc5f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=59,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=708000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=60,type=1)],length=64,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=59)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:23.991355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc61,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=60,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=707000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],length=80,match=OFPMatch(oxm_fields={}),packet_count=0,priority=3,table_id=60)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:23.994358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc63,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=62,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=697000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],length=80,match=OFPMatch(oxm_fields={}),packet_count=0,priority=3,table_id=62)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:23.998075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc65,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=71,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=827000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[NXActionCTClear(experimenter=8992,len=16,subtype=43,type=65535), NXActionResubmitTable(experimenter=8992,in_port=65528,len=16,subtype=14,table_id=71,type=65535)],len=40,type=4)],length=104,match=OFPMatch(oxm_fields={'ct_state': (32, 32)}),packet_count=0,priority=110,table_id=71), OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=884000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=71)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:24.000308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc67,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=72,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=875000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=72)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:24.002573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc69,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=73,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=865000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=73)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:24.004403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc6b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=77,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:24.006252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc6d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=78,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:24.008285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc6f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=81,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=860000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=81)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:24.010485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc71,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=82,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=851000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=82)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:24.012995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc73,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=91,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=820000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[NXActionResubmitTable(experimenter=8992,in_port=65528,len=16,subtype=14,table_id=94,type=65535)],len=24,type=4)],length=80,match=OFPMatch(oxm_fields={}),packet_count=0,priority=1,table_id=91)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:24.015058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc75,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=92,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=811000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=92)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:24.017067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc77,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=93,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=802000000,duration_sec=1,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=93)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:24.017433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Cleaning stale br-data flows Sep 25 00:47:24.017730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Reserved cookies for br-data: {13979250796582379444} Sep 25 00:47:24.020331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xa5d7ab2e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=0,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=13979250796582379444,duration_nsec=581000000,duration_sec=5,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=64,match=OFPMatch(oxm_fields={'in_port': 2}),packet_count=0,priority=2,table_id=0), OFPFlowStats(byte_count=1000,cookie=13979250796582379444,duration_nsec=650000000,duration_sec=5,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],length=80,match=OFPMatch(oxm_fields={}),packet_count=4,priority=0,table_id=0)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:24.022252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xa5d7ab30,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=1,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:24.024122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xa5d7ab32,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=2,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:24.026017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xa5d7ab34,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=3,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:24.026346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:0 - cleanup stale flows. Elapsed:0.071 Sep 25 00:47:24.026695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:0 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.072 Sep 25 00:47:25.956420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:1 started Sep 25 00:47:25.959356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc79,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=685000000,duration_sec=8,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:25.959917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:47:25.960314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:1 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:47:27.957698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:2 started Sep 25 00:47:27.960150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc7b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=686000000,duration_sec=10,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:27.961288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:47:27.961651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:2 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:47:29.581603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: WARNING oslo_policy.policy [None req-2c95282d-9daa-4819-9314-d06eb9d528e9 demo demo] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 25 00:47:29.582206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: WARNING oslo_policy.policy [None req-2c95282d-9daa-4819-9314-d06eb9d528e9 demo demo] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 25 00:47:29.587111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2c95282d-9daa-4819-9314-d06eb9d528e9 demo demo] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:47:29Z,description='Default security group',id=892bf66d-0a02-4e9d-acb9-1dcd401f5d5c,is_default=True,name='default',project_id='cd69c40698884b3192bb19ba6968842d',revision_number=1,rules=[SecurityGroupRule(151c22b8-5819-4bf1-8683-f164a499dfbd),SecurityGroupRule(46fdfbbf-d37d-495c-a352-f9e593b4c8fa),SecurityGroupRule(48061a20-6a50-4a8c-8b50-917c7656fa4c),SecurityGroupRule(e29826b7-7070-40bc-a048-54302175de86)],shared=False,stateful=True,updated_at=2022-09-25T00:47:29Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:47:29.587627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2c95282d-9daa-4819-9314-d06eb9d528e9 demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (892bf66d-0a02-4e9d-acb9-1dcd401f5d5c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:47:29.588275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2c95282d-9daa-4819-9314-d06eb9d528e9 demo demo] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:47:29Z,description=,direction='egress',ethertype='IPv6',id=151c22b8-5819-4bf1-8683-f164a499dfbd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cd69c40698884b3192bb19ba6968842d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=892bf66d-0a02-4e9d-acb9-1dcd401f5d5c,updated_at=2022-09-25T00:47:29Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:47:29.588842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2c95282d-9daa-4819-9314-d06eb9d528e9 demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (151c22b8-5819-4bf1-8683-f164a499dfbd), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:47:29.589324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2c95282d-9daa-4819-9314-d06eb9d528e9 demo demo] Security group rule updated ['892bf66d-0a02-4e9d-acb9-1dcd401f5d5c'] Sep 25 00:47:29.590142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2c95282d-9daa-4819-9314-d06eb9d528e9 demo demo] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:47:29Z,description=,direction='egress',ethertype='IPv4',id=46fdfbbf-d37d-495c-a352-f9e593b4c8fa,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cd69c40698884b3192bb19ba6968842d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=892bf66d-0a02-4e9d-acb9-1dcd401f5d5c,updated_at=2022-09-25T00:47:29Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:47:29.590578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2c95282d-9daa-4819-9314-d06eb9d528e9 demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (46fdfbbf-d37d-495c-a352-f9e593b4c8fa), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:47:29.590926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2c95282d-9daa-4819-9314-d06eb9d528e9 demo demo] Security group rule updated ['892bf66d-0a02-4e9d-acb9-1dcd401f5d5c'] Sep 25 00:47:29.591602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2c95282d-9daa-4819-9314-d06eb9d528e9 demo demo] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:47:29Z,description=,direction='ingress',ethertype='IPv6',id=48061a20-6a50-4a8c-8b50-917c7656fa4c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cd69c40698884b3192bb19ba6968842d',protocol=,remote_address_group_id=,remote_group_id=892bf66d-0a02-4e9d-acb9-1dcd401f5d5c,remote_ip_prefix=,revision_number=0,security_group_id=892bf66d-0a02-4e9d-acb9-1dcd401f5d5c,updated_at=2022-09-25T00:47:29Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:47:29.591955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2c95282d-9daa-4819-9314-d06eb9d528e9 demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (48061a20-6a50-4a8c-8b50-917c7656fa4c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:47:29.592991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2c95282d-9daa-4819-9314-d06eb9d528e9 demo demo] Security group rule updated ['892bf66d-0a02-4e9d-acb9-1dcd401f5d5c'] Sep 25 00:47:29.592991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2c95282d-9daa-4819-9314-d06eb9d528e9 demo demo] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:47:29Z,description=,direction='ingress',ethertype='IPv4',id=e29826b7-7070-40bc-a048-54302175de86,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cd69c40698884b3192bb19ba6968842d',protocol=,remote_address_group_id=,remote_group_id=892bf66d-0a02-4e9d-acb9-1dcd401f5d5c,remote_ip_prefix=,revision_number=0,security_group_id=892bf66d-0a02-4e9d-acb9-1dcd401f5d5c,updated_at=2022-09-25T00:47:29Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:47:29.593330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2c95282d-9daa-4819-9314-d06eb9d528e9 demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (e29826b7-7070-40bc-a048-54302175de86), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:47:29.593664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2c95282d-9daa-4819-9314-d06eb9d528e9 demo demo] Security group rule updated ['892bf66d-0a02-4e9d-acb9-1dcd401f5d5c'] Sep 25 00:47:29.759677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2c95282d-9daa-4819-9314-d06eb9d528e9 demo demo] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-25T00:47:29Z,description='',dns_domain=None,id=8b6eca5d-d3ce-4a2a-bfe0-96b8d0088636,mtu=1500,name='private',project_id='cd69c40698884b3192bb19ba6968842d',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(8b6eca5d-d3ce-4a2a-bfe0-96b8d0088636),segments=[NetworkSegment(f5d62f00-6fe9-44d6-811a-2100de42d416)],shared=False,status='ACTIVE',updated_at=2022-09-25T00:47:29Z,vlan_transparent=) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:47:29.760187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2c95282d-9daa-4819-9314-d06eb9d528e9 demo demo] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (8b6eca5d-d3ce-4a2a-bfe0-96b8d0088636), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:47:29.907212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager [None req-2c95282d-9daa-4819-9314-d06eb9d528e9 demo demo] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 8b6eca5d-d3ce-4a2a-bfe0-96b8d0088636 with segmentation id not found. Sep 25 00:47:29.907212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 25 00:47:29.907212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 25 00:47:29.907212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 25 00:47:29.907212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 25 00:47:29.907212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 25 00:47:29.907212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 25 00:47:29.907212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 25 00:47:29.907212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 25 00:47:29.907212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 25 00:47:29.907212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 25 00:47:29.907212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 25 00:47:29.907212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 25 00:47:29.908367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 25 00:47:29.908367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 25 00:47:29.908367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 25 00:47:29.908367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 8b6eca5d-d3ce-4a2a-bfe0-96b8d0088636 with segmentation id not found. Sep 25 00:47:29.908367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Sep 25 00:47:29.958116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:3 started Sep 25 00:47:29.961593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc7d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=687000000,duration_sec=12,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:29.962217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:47:29.962590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:3 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:47:31.958992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:4 started Sep 25 00:47:31.961535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc7f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=687000000,duration_sec=14,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:31.962138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:47:31.963125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:4 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:47:33.514394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-290e4be1-abe9-4575-abd1-7d3594b49b42 demo admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(22d5eaec-f62f-417b-bed2-0579b6163dd8)],cidr=172.20.0.0/26,created_at=2022-09-25T00:47:33Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=d5743fda-09f8-4431-b8e1-5a0f79780c1c,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='private-subnet',network_id=8b6eca5d-d3ce-4a2a-bfe0-96b8d0088636,project_id='cd69c40698884b3192bb19ba6968842d',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id='914dd839-8b81-49ae-9aa3-e8c848c17069',updated_at=2022-09-25T00:47:33Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:47:33.515307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-290e4be1-abe9-4575-abd1-7d3594b49b42 demo admin] Publish callbacks [] for Subnet (d5743fda-09f8-4431-b8e1-5a0f79780c1c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:47:33.959837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:5 started Sep 25 00:47:33.965087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc81,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=689000000,duration_sec=16,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:33.967353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:47:33.968043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:5 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 25 00:47:34.703787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c7f3a638-0320-42ba-8c6d-96828c6bc590 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:47:33Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-8b6eca5d-d3ce-4a2a-bfe0-96b8d0088636',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=5204c0c3-4410-4695-a405-b599292c4e80,mac_address=fa:16:3e:bf:1b:4a,name='',network_id=8b6eca5d-d3ce-4a2a-bfe0-96b8d0088636,numa_affinity_policy=,project_id='cd69c40698884b3192bb19ba6968842d',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(5204c0c3-4410-4695-a405-b599292c4e80),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:47:34Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:47:34.704503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c7f3a638-0320-42ba-8c6d-96828c6bc590 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (5204c0c3-4410-4695-a405-b599292c4e80), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:47:34.984519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c7f3a638-0320-42ba-8c6d-96828c6bc590 None None] Resource Port 5204c0c3-4410-4695-a405-b599292c4e80 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=5204c0c3-4410-4695-a405-b599292c4e80,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=5204c0c3-4410-4695-a405-b599292c4e80,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=5204c0c3-4410-4695-a405-b599292c4e80,segment=NetworkSegment(f5d62f00-6fe9-44d6-811a-2100de42d416),segment_id=f5d62f00-6fe9-44d6-811a-2100de42d416)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:47:34.984912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c7f3a638-0320-42ba-8c6d-96828c6bc590 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (5204c0c3-4410-4695-a405-b599292c4e80), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:47:35.961145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:6 started Sep 25 00:47:35.967473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc83,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=690000000,duration_sec=18,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:35.968062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:47:35.968404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:6 - starting polling. Elapsed:0.008 Sep 25 00:47:35.969545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:47:35.970575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:6 - port information retrieved. Elapsed:0.010 Sep 25 00:47:35.970909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:6 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 25 00:47:37.961325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:7 started Sep 25 00:47:37.964504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc85,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=690000000,duration_sec=20,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:37.965080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:47:37.965482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:7 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:47:39.961797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:8 started Sep 25 00:47:39.964580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc87,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=690000000,duration_sec=22,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:39.965287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:47:39.965740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:8 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:47:41.962761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:9 started Sep 25 00:47:41.965528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc89,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=691000000,duration_sec=24,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:41.966081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:47:41.966443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:9 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:47:42.099320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5c7285e3-b550-4b8c-8caf-2522d2b2fe44","insert","tap5204c0c3-44",["set",[]],["map",[["attached-mac","fa:16:3e:bf:1b:4a"],["iface-id","5204c0c3-4410-4695-a405-b599292c4e80"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:47:42.122113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5c7285e3-b550-4b8c-8caf-2522d2b2fe44","old",null,["set",[]],null],["","new","tap5204c0c3-44",2,["map",[["attached-mac","fa:16:3e:bf:1b:4a"],["iface-id","5204c0c3-4410-4695-a405-b599292c4e80"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:47:43.864171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d2915ddd-8d8a-4ae2-8bb7-42abedbd187e None None] Resource Port 5204c0c3-4410-4695-a405-b599292c4e80 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:47:43.864879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d2915ddd-8d8a-4ae2-8bb7-42abedbd187e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (5204c0c3-4410-4695-a405-b599292c4e80), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:47:43.964131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:10 started Sep 25 00:47:43.966851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc8b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=693000000,duration_sec=26,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:43.967572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:47:43.968135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:10 - starting polling. Elapsed:0.004 Sep 25 00:47:43.969228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:47:43.970243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:10 - port information retrieved. Elapsed:0.006 Sep 25 00:47:43.970680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'5204c0c3-4410-4695-a405-b599292c4e80'}, 'added': {'5204c0c3-4410-4695-a405-b599292c4e80'}, 'removed': set(), 'updated': {'5204c0c3-4410-4695-a405-b599292c4e80'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:47:43.971386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '5204c0c3-4410-4695-a405-b599292c4e80', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-8b6eca5d-d3ce-4a2a-bfe0-96b8d0088636', 'network_id': '8b6eca5d-d3ce-4a2a-bfe0-96b8d0088636', 'port_id': '5204c0c3-4410-4695-a405-b599292c4e80', 'mac_address': 'fa:16:3e:bf:1b:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 62, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd5743fda-09f8-4431-b8e1-5a0f79780c1c', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:47:43.972455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 5204c0c3-4410-4695-a405-b599292c4e80 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:47:43.972899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 5204c0c3-4410-4695-a405-b599292c4e80 updated. Details: {'device': '5204c0c3-4410-4695-a405-b599292c4e80', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-8b6eca5d-d3ce-4a2a-bfe0-96b8d0088636', 'network_id': '8b6eca5d-d3ce-4a2a-bfe0-96b8d0088636', 'port_id': '5204c0c3-4410-4695-a405-b599292c4e80', 'mac_address': 'fa:16:3e:bf:1b:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 62, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd5743fda-09f8-4431-b8e1-5a0f79780c1c', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 25 00:47:43.973430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Assigning 1 as local vlan for net-id=8b6eca5d-d3ce-4a2a-bfe0-96b8d0088636, seg-id=62 Sep 25 00:47:43.976869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xa5d7ab36,OFPFlowMod(buffer_id=4294967295,command=0,cookie=13979250796582379444,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4158), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4097}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:43.979327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x7834dc8d,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4097)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4158}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:43.980524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap5204c0c3-44, col_values=(('tag', 1),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:47:43.981201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap5204c0c3-44, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:47:43.981796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap5204c0c3-44, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:47:43.986330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap5204c0c3-44, col_values=(('other_config', {'net_uuid': '8b6eca5d-d3ce-4a2a-bfe0-96b8d0088636', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '1', 'segmentation_id': '62'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:47:43.996346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834dc8f,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:43.997007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:10 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 1 devices currently available. Time elapsed: 0.026 Sep 25 00:47:43.997479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing device filters for 1 new devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 25 00:47:43.998361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing filters for devices {'5204c0c3-4410-4695-a405-b599292c4e80'} Sep 25 00:47:43.999830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:47:44.000176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:47:44.002694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:47:44.043607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3041bf69-867b-4d0f-ab79-63de10d16393]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:47:44.044485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:10 - agent port security group processed in 0.073 Sep 25 00:47:44.045132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 5204c0c3-4410-4695-a405-b599292c4e80 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:47:44.173745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['5204c0c3-4410-4695-a405-b599292c4e80'] and devices down [] completed. Sep 25 00:47:44.174074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:10 - ports processed. Elapsed:0.210 Sep 25 00:47:44.174417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:10 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.210 Sep 25 00:47:45.964789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:11 started Sep 25 00:47:45.967302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc91,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=693000000,duration_sec=28,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:45.967874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:47:45.968239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:11 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:47:47.965790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:12 started Sep 25 00:47:47.968442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc93,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=694000000,duration_sec=30,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:47.969006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:47:47.969389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:12 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:47:49.735416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8c6fb245-4252-465d-b78c-68493974bd26 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:47:49Z,description='Default security group',id=cede5ae8-3d39-46a3-b5f4-44b6d29b42a7,is_default=True,name='default',project_id='c8e32a9668254c2e96354fd797883364',revision_number=1,rules=[SecurityGroupRule(2abf61a4-a252-434d-ac15-66dc2724e6b1),SecurityGroupRule(aac21a3d-22d4-469b-9815-9ec5f57d98bc),SecurityGroupRule(c22f2c97-b2af-4392-a18a-68aea44b3d14),SecurityGroupRule(fd871e79-d147-4df0-af45-96a2823c379a)],shared=False,stateful=True,updated_at=2022-09-25T00:47:49Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:47:49.736054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8c6fb245-4252-465d-b78c-68493974bd26 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (cede5ae8-3d39-46a3-b5f4-44b6d29b42a7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:47:49.736480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8c6fb245-4252-465d-b78c-68493974bd26 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:47:49Z,description=,direction='egress',ethertype='IPv6',id=2abf61a4-a252-434d-ac15-66dc2724e6b1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c8e32a9668254c2e96354fd797883364',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=cede5ae8-3d39-46a3-b5f4-44b6d29b42a7,updated_at=2022-09-25T00:47:49Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:47:49.737048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8c6fb245-4252-465d-b78c-68493974bd26 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (2abf61a4-a252-434d-ac15-66dc2724e6b1), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:47:49.737437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8c6fb245-4252-465d-b78c-68493974bd26 admin admin] Security group rule updated ['cede5ae8-3d39-46a3-b5f4-44b6d29b42a7'] Sep 25 00:47:49.738114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8c6fb245-4252-465d-b78c-68493974bd26 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:47:49Z,description=,direction='egress',ethertype='IPv4',id=aac21a3d-22d4-469b-9815-9ec5f57d98bc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c8e32a9668254c2e96354fd797883364',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=cede5ae8-3d39-46a3-b5f4-44b6d29b42a7,updated_at=2022-09-25T00:47:49Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:47:49.738504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8c6fb245-4252-465d-b78c-68493974bd26 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (aac21a3d-22d4-469b-9815-9ec5f57d98bc), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:47:49.738842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8c6fb245-4252-465d-b78c-68493974bd26 admin admin] Security group rule updated ['cede5ae8-3d39-46a3-b5f4-44b6d29b42a7'] Sep 25 00:47:49.739539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8c6fb245-4252-465d-b78c-68493974bd26 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:47:49Z,description=,direction='ingress',ethertype='IPv6',id=c22f2c97-b2af-4392-a18a-68aea44b3d14,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c8e32a9668254c2e96354fd797883364',protocol=,remote_address_group_id=,remote_group_id=cede5ae8-3d39-46a3-b5f4-44b6d29b42a7,remote_ip_prefix=,revision_number=0,security_group_id=cede5ae8-3d39-46a3-b5f4-44b6d29b42a7,updated_at=2022-09-25T00:47:49Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:47:49.740203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8c6fb245-4252-465d-b78c-68493974bd26 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (c22f2c97-b2af-4392-a18a-68aea44b3d14), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:47:49.741281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8c6fb245-4252-465d-b78c-68493974bd26 admin admin] Security group rule updated ['cede5ae8-3d39-46a3-b5f4-44b6d29b42a7'] Sep 25 00:47:49.742255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8c6fb245-4252-465d-b78c-68493974bd26 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:47:49Z,description=,direction='ingress',ethertype='IPv4',id=fd871e79-d147-4df0-af45-96a2823c379a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c8e32a9668254c2e96354fd797883364',protocol=,remote_address_group_id=,remote_group_id=cede5ae8-3d39-46a3-b5f4-44b6d29b42a7,remote_ip_prefix=,revision_number=0,security_group_id=cede5ae8-3d39-46a3-b5f4-44b6d29b42a7,updated_at=2022-09-25T00:47:49Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:47:49.742620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8c6fb245-4252-465d-b78c-68493974bd26 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (fd871e79-d147-4df0-af45-96a2823c379a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:47:49.742959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8c6fb245-4252-465d-b78c-68493974bd26 admin admin] Security group rule updated ['cede5ae8-3d39-46a3-b5f4-44b6d29b42a7'] Sep 25 00:47:49.922395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8c6fb245-4252-465d-b78c-68493974bd26 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-25T00:47:49Z,description='',dns_domain=None,id=62195cd6-54fa-4e24-9d47-ae0de6356ac2,mtu=1500,name='public',project_id='c8e32a9668254c2e96354fd797883364',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(62195cd6-54fa-4e24-9d47-ae0de6356ac2),segments=[NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)],shared=False,status='ACTIVE',updated_at=2022-09-25T00:47:49Z,vlan_transparent=) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:47:49.922793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8c6fb245-4252-465d-b78c-68493974bd26 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (62195cd6-54fa-4e24-9d47-ae0de6356ac2), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:47:49.966679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:13 started Sep 25 00:47:49.969293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc95,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=695000000,duration_sec=32,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:49.970203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:47:49.970755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:13 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:47:51.967742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:14 started Sep 25 00:47:51.970377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc97,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=696000000,duration_sec=34,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:51.970976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:47:51.971331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:14 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:47:53.968529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:15 started Sep 25 00:47:53.974084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc99,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=697000000,duration_sec=36,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:53.974690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:47:53.975050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:15 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 00:47:54.198768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d406e2d0-9604-491d-9e6b-4575d93858bc demo admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:47:53Z,data_plane_status=None,description='',device_id='842b482a-ca8f-4a3d-b347-1715a63eaf96',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=fa672580-39eb-4bef-ac5b-6be835c6c88c,mac_address=fa:16:3e:4d:25:80,name='',network_id=8b6eca5d-d3ce-4a2a-bfe0-96b8d0088636,numa_affinity_policy=,project_id='cd69c40698884b3192bb19ba6968842d',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(fa672580-39eb-4bef-ac5b-6be835c6c88c),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:47:53Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:47:54.199162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d406e2d0-9604-491d-9e6b-4575d93858bc demo admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (fa672580-39eb-4bef-ac5b-6be835c6c88c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:47:54.670340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d406e2d0-9604-491d-9e6b-4575d93858bc demo admin] Received resource Port update without any changes: fa672580-39eb-4bef-ac5b-6be835c6c88c {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 25 00:47:55.969786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:16 started Sep 25 00:47:55.973455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc9b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=699000000,duration_sec=38,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:55.974441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:47:55.975078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:16 - starting polling. Elapsed:0.005 Sep 25 00:47:55.976881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:47:55.978054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:16 - port information retrieved. Elapsed:0.008 Sep 25 00:47:55.978598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:16 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 25 00:47:56.460822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f67052da-289c-4007-9b35-d500f28f3415 None None] Resource Port fa672580-39eb-4bef-ac5b-6be835c6c88c updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=fa672580-39eb-4bef-ac5b-6be835c6c88c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=fa672580-39eb-4bef-ac5b-6be835c6c88c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:47:56.461217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f67052da-289c-4007-9b35-d500f28f3415 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (fa672580-39eb-4bef-ac5b-6be835c6c88c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:47:56.783378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f67052da-289c-4007-9b35-d500f28f3415 None None] Resource Port fa672580-39eb-4bef-ac5b-6be835c6c88c updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=fa672580-39eb-4bef-ac5b-6be835c6c88c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=fa672580-39eb-4bef-ac5b-6be835c6c88c,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=fa672580-39eb-4bef-ac5b-6be835c6c88c,segment=NetworkSegment(f5d62f00-6fe9-44d6-811a-2100de42d416),segment_id=f5d62f00-6fe9-44d6-811a-2100de42d416)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:47:56.783769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f67052da-289c-4007-9b35-d500f28f3415 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (fa672580-39eb-4bef-ac5b-6be835c6c88c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:47:57.280053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-bdaa7308-8dbf-42a5-81a4-70522b4820f3 None None] Resource Port fa672580-39eb-4bef-ac5b-6be835c6c88c updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:47:57.281344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-bdaa7308-8dbf-42a5-81a4-70522b4820f3 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (fa672580-39eb-4bef-ac5b-6be835c6c88c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:47:57.970560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:17 started Sep 25 00:47:57.973721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc9d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=699000000,duration_sec=40,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:57.974482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:47:57.974834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:17 - starting polling. Elapsed:0.005 Sep 25 00:47:57.976091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:47:57.976970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:17 - port information retrieved. Elapsed:0.007 Sep 25 00:47:57.981492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:17 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 00:47:58.572041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ff2b0d67-c60a-473d-909c-4e163124d332 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(a2587937-59f3-4b25-aed2-28fe738741fb)],cidr=172.37.1.0/24,created_at=2022-09-25T00:47:58Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.37.1.1,host_routes=[],id=d01a90bc-22e7-43bc-8649-e22859dad8e0,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='public-subnet',network_id=62195cd6-54fa-4e24-9d47-ae0de6356ac2,project_id='c8e32a9668254c2e96354fd797883364',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-25T00:47:58Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:47:58.572764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ff2b0d67-c60a-473d-909c-4e163124d332 admin admin] Publish callbacks [] for Subnet (d01a90bc-22e7-43bc-8649-e22859dad8e0), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:47:59.975906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:18 started Sep 25 00:47:59.978555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dc9f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=704000000,duration_sec=42,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:47:59.979124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:47:59.979478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:18 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:48:01.860580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["91f62586-1eac-47e3-aca6-8ab30d2c437c","insert","qr-fa672580-39",["set",[]],["map",[["attached-mac","fa:16:3e:4d:25:80"],["iface-id","fa672580-39eb-4bef-ac5b-6be835c6c88c"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:48:01.881727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["91f62586-1eac-47e3-aca6-8ab30d2c437c","old",null,["set",[]],null],["","new","qr-fa672580-39",3,["map",[["attached-mac","fa:16:3e:4d:25:80"],["iface-id","fa672580-39eb-4bef-ac5b-6be835c6c88c"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:48:01.976412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:19 started Sep 25 00:48:01.980213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dca1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=705000000,duration_sec=44,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:01.980213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:48:01.980213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:19 - starting polling. Elapsed:0.004 Sep 25 00:48:01.981149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:48:01.982299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:19 - port information retrieved. Elapsed:0.006 Sep 25 00:48:01.982805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'fa672580-39eb-4bef-ac5b-6be835c6c88c', '5204c0c3-4410-4695-a405-b599292c4e80'}, 'added': {'fa672580-39eb-4bef-ac5b-6be835c6c88c'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:48:01.983527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': 'fa672580-39eb-4bef-ac5b-6be835c6c88c', 'device_id': '842b482a-ca8f-4a3d-b347-1715a63eaf96', 'network_id': '8b6eca5d-d3ce-4a2a-bfe0-96b8d0088636', 'port_id': 'fa672580-39eb-4bef-ac5b-6be835c6c88c', 'mac_address': 'fa:16:3e:4d:25:80', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 62, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd5743fda-09f8-4431-b8e1-5a0f79780c1c', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:48:01.984948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: fa672580-39eb-4bef-ac5b-6be835c6c88c {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:48:01.985535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port fa672580-39eb-4bef-ac5b-6be835c6c88c updated. Details: {'device': 'fa672580-39eb-4bef-ac5b-6be835c6c88c', 'device_id': '842b482a-ca8f-4a3d-b347-1715a63eaf96', 'network_id': '8b6eca5d-d3ce-4a2a-bfe0-96b8d0088636', 'port_id': 'fa672580-39eb-4bef-ac5b-6be835c6c88c', 'mac_address': 'fa:16:3e:4d:25:80', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 62, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd5743fda-09f8-4431-b8e1-5a0f79780c1c', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 1} Sep 25 00:48:01.987569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-fa672580-39, col_values=(('tag', 1),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:48:01.988286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-fa672580-39, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:48:01.988797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-fa672580-39, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:48:01.995530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-fa672580-39, col_values=(('other_config', {'net_uuid': '8b6eca5d-d3ce-4a2a-bfe0-96b8d0088636', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '1', 'segmentation_id': '62'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:48:02.004131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834dca3,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 3}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:02.004618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:19 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 2 devices currently available. Time elapsed: 0.021 Sep 25 00:48:02.004977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing device filters for 1 new devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 25 00:48:02.005342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing filters for devices {'fa672580-39eb-4bef-ac5b-6be835c6c88c'} Sep 25 00:48:02.007341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:48:02.007627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:48:02.009700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:48:02.047815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[157f969a-abb9-4fcc-9ef2-bb177ef24db8]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:48:02.048680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:19 - agent port security group processed in 0.065 Sep 25 00:48:02.049470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for fa672580-39eb-4bef-ac5b-6be835c6c88c to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:48:02.200887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['fa672580-39eb-4bef-ac5b-6be835c6c88c'] and devices down [] completed. Sep 25 00:48:02.201217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:19 - ports processed. Elapsed:0.225 Sep 25 00:48:02.201589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:19 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:0.225 Sep 25 00:48:03.182295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-75d8df88-fd2e-4d8e-a6b8-e5a8b6ce1eec demo admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:48:02Z,data_plane_status=None,description='',device_id='842b482a-ca8f-4a3d-b347-1715a63eaf96',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=de4727a2-569d-44c6-a53e-ecc89817f610,mac_address=fa:16:3e:cb:c1:6c,name='',network_id=62195cd6-54fa-4e24-9d47-ae0de6356ac2,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(de4727a2-569d-44c6-a53e-ecc89817f610),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:48:02Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:48:03.182974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-75d8df88-fd2e-4d8e-a6b8-e5a8b6ce1eec demo admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (de4727a2-569d-44c6-a53e-ecc89817f610), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:48:03.976832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:20 started Sep 25 00:48:03.979226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dca5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=705000000,duration_sec=46,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:03.979822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:48:03.980164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:20 - starting polling. Elapsed:0.004 Sep 25 00:48:03.981236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:48:03.982296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:20 - port information retrieved. Elapsed:0.006 Sep 25 00:48:03.982626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:20 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 00:48:05.049315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-56d4a43b-dedf-4589-a7e3-c50c053fcfb1 None None] Resource Port de4727a2-569d-44c6-a53e-ecc89817f610 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=de4727a2-569d-44c6-a53e-ecc89817f610,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=de4727a2-569d-44c6-a53e-ecc89817f610,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:48:05.050206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-56d4a43b-dedf-4589-a7e3-c50c053fcfb1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (de4727a2-569d-44c6-a53e-ecc89817f610), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:48:05.227451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-56d4a43b-dedf-4589-a7e3-c50c053fcfb1 None None] Resource Port de4727a2-569d-44c6-a53e-ecc89817f610 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=de4727a2-569d-44c6-a53e-ecc89817f610,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=de4727a2-569d-44c6-a53e-ecc89817f610,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=de4727a2-569d-44c6-a53e-ecc89817f610,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:48:05.228164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-56d4a43b-dedf-4589-a7e3-c50c053fcfb1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (de4727a2-569d-44c6-a53e-ecc89817f610), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:48:05.571520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["08452f85-e2ff-42a3-b546-d33b24abe8c3","insert","qg-de4727a2-56",["set",[]],["map",[["attached-mac","fa:16:3e:cb:c1:6c"],["iface-id","de4727a2-569d-44c6-a53e-ecc89817f610"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:48:05.600924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["08452f85-e2ff-42a3-b546-d33b24abe8c3","old",null,["set",[]],null],["","new","qg-de4727a2-56",4,["map",[["attached-mac","fa:16:3e:cb:c1:6c"],["iface-id","de4727a2-569d-44c6-a53e-ecc89817f610"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:48:05.978386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:21 started Sep 25 00:48:05.980894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dca7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=707000000,duration_sec=48,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:05.981511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:48:05.981977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:21 - starting polling. Elapsed:0.004 Sep 25 00:48:05.983141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:48:05.984564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:21 - port information retrieved. Elapsed:0.006 Sep 25 00:48:05.984889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'5204c0c3-4410-4695-a405-b599292c4e80', 'de4727a2-569d-44c6-a53e-ecc89817f610', 'fa672580-39eb-4bef-ac5b-6be835c6c88c'}, 'added': {'de4727a2-569d-44c6-a53e-ecc89817f610'}, 'removed': set(), 'updated': {'de4727a2-569d-44c6-a53e-ecc89817f610'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:48:05.985509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': 'de4727a2-569d-44c6-a53e-ecc89817f610', 'device_id': '842b482a-ca8f-4a3d-b347-1715a63eaf96', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': 'de4727a2-569d-44c6-a53e-ecc89817f610', 'mac_address': 'fa:16:3e:cb:c1:6c', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.61'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:48:05.986626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: de4727a2-569d-44c6-a53e-ecc89817f610 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:48:05.986963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port de4727a2-569d-44c6-a53e-ecc89817f610 updated. Details: {'device': 'de4727a2-569d-44c6-a53e-ecc89817f610', 'device_id': '842b482a-ca8f-4a3d-b347-1715a63eaf96', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': 'de4727a2-569d-44c6-a53e-ecc89817f610', 'mac_address': 'fa:16:3e:cb:c1:6c', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.61'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 25 00:48:05.987295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Assigning 2 as local vlan for net-id=62195cd6-54fa-4e24-9d47-ae0de6356ac2, seg-id=None Sep 25 00:48:05.990122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xa5d7ab38,OFPFlowMod(buffer_id=4294967295,command=0,cookie=13979250796582379444,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionPopVlan(len=8,type=18), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=32,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4098}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:05.993922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0x7834dca9,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionPushVlan(ethertype=33024,len=8,type=17), OFPActionSetField(vlan_vid=4098)],len=32,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 0}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:05.995044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-de4727a2-56, col_values=(('tag', 2),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:48:05.995550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-de4727a2-56, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:48:05.996243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-de4727a2-56, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:48:06.003873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-de4727a2-56, col_values=(('other_config', {'net_uuid': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:48:06.016344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834dcab,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 4}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:06.017044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:21 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 3 devices currently available. Time elapsed: 0.032 Sep 25 00:48:06.017502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing device filters for 1 new devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 25 00:48:06.017901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing filters for devices {'de4727a2-569d-44c6-a53e-ecc89817f610'} Sep 25 00:48:06.019165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:48:06.019534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:48:06.021745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:48:06.063208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6816515-9d75-40d8-816b-a810e8752933]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:48:06.063861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:21 - agent port security group processed in 0.079 Sep 25 00:48:06.065524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for de4727a2-569d-44c6-a53e-ecc89817f610 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:48:06.244700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['de4727a2-569d-44c6-a53e-ecc89817f610'] and devices down [] completed. Sep 25 00:48:06.245219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:21 - ports processed. Elapsed:0.267 Sep 25 00:48:06.245760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:21 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.268 Sep 25 00:48:06.311876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Resource Port de4727a2-569d-44c6-a53e-ecc89817f610 updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=de4727a2-569d-44c6-a53e-ecc89817f610,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=de4727a2-569d-44c6-a53e-ecc89817f610,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)], 'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:48:06.312302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (de4727a2-569d-44c6-a53e-ecc89817f610), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:48:07.979260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:22 started Sep 25 00:48:07.981714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcad,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=708000000,duration_sec=50,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:07.982294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:48:07.982634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:22 - starting polling. Elapsed:0.004 Sep 25 00:48:07.983814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:48:07.985682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:22 - port information retrieved. Elapsed:0.006 Sep 25 00:48:07.985682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'fa672580-39eb-4bef-ac5b-6be835c6c88c', 'de4727a2-569d-44c6-a53e-ecc89817f610', '5204c0c3-4410-4695-a405-b599292c4e80'}, 'added': set(), 'removed': set(), 'updated': {'de4727a2-569d-44c6-a53e-ecc89817f610'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:48:07.986653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': 'de4727a2-569d-44c6-a53e-ecc89817f610', 'device_id': '842b482a-ca8f-4a3d-b347-1715a63eaf96', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': 'de4727a2-569d-44c6-a53e-ecc89817f610', 'mac_address': 'fa:16:3e:cb:c1:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.61'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:48:07.987413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: de4727a2-569d-44c6-a53e-ecc89817f610 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:48:07.987740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port de4727a2-569d-44c6-a53e-ecc89817f610 updated. Details: {'device': 'de4727a2-569d-44c6-a53e-ecc89817f610', 'device_id': '842b482a-ca8f-4a3d-b347-1715a63eaf96', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': 'de4727a2-569d-44c6-a53e-ecc89817f610', 'mac_address': 'fa:16:3e:cb:c1:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.61'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 25 00:48:07.988837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-de4727a2-56, col_values=(('tag', 2),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:48:07.989180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-de4727a2-56, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:48:07.989628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-de4727a2-56, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:48:07.990078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:48:07.991692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-de4727a2-56, col_values=(('other_config', {'net_uuid': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:48:07.992410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:48:07.994834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834dcaf,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 4}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:07.995179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:22 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 3 devices currently available. Time elapsed: 0.009 Sep 25 00:48:07.995532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refreshing firewall for 1 devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 25 00:48:07.995826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refresh firewall rules Sep 25 00:48:07.997101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:48:07.997422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:48:08.000573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:48:08.047756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6bc504-0557-4ab3-9af7-6d5b41a23338]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:48:08.048558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:22 - agent port security group processed in 0.063 Sep 25 00:48:08.049150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for de4727a2-569d-44c6-a53e-ecc89817f610 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:48:08.202012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['de4727a2-569d-44c6-a53e-ecc89817f610'] and devices down [] completed. Sep 25 00:48:08.202438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:22 - ports processed. Elapsed:0.223 Sep 25 00:48:08.203135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:22 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.224 Sep 25 00:48:09.980511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:23 started Sep 25 00:48:09.982930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcb1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=709000000,duration_sec=52,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:09.983494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:48:09.983850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:23 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 25 00:48:11.981820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:24 started Sep 25 00:48:11.984761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcb3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=710000000,duration_sec=54,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:11.985331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:48:11.985685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:24 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:48:13.982034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:25 started Sep 25 00:48:13.985095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcb5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=710000000,duration_sec=56,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:13.989963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:48:13.990761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:25 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 25 00:48:15.982932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:26 started Sep 25 00:48:15.986078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcb7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=711000000,duration_sec=58,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:15.986659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:48:15.987019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:26 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:48:17.983742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:27 started Sep 25 00:48:17.987150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcb9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=713000000,duration_sec=60,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:17.988099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:48:17.988570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:27 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:48:19.984386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:28 started Sep 25 00:48:19.987278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcbb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=713000000,duration_sec=62,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:19.987980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:48:19.988343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:28 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:48:21.985580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:29 started Sep 25 00:48:21.988506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcbd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=714000000,duration_sec=64,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:21.989181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:48:21.989655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:29 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:48:23.988183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:30 started Sep 25 00:48:23.997376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcbf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=718000000,duration_sec=66,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:24.000665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:48:24.001625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:30 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Sep 25 00:48:25.988571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:31 started Sep 25 00:48:25.996157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcc1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=718000000,duration_sec=68,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:25.997164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:48:25.997912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:31 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 25 00:48:27.992212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:32 started Sep 25 00:48:27.995327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcc3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=721000000,duration_sec=70,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:27.996001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:48:27.996356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:32 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:48:29.993695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:33 started Sep 25 00:48:29.999502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcc5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=724000000,duration_sec=72,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:30.001836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:48:30.002860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:33 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 25 00:48:31.994999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:34 started Sep 25 00:48:32.001004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcc7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=724000000,duration_sec=74,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:32.002513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:48:32.003375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:34 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 25 00:48:33.996824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:35 started Sep 25 00:48:34.001096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcc9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=726000000,duration_sec=76,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:34.002023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:48:34.002583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:35 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 00:48:35.998962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:36 started Sep 25 00:48:36.002978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dccb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=727000000,duration_sec=78,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:36.003934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:48:36.004702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:36 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 00:48:38.002386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:37 started Sep 25 00:48:38.045456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dccd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=755000000,duration_sec=80,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:38.050835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:48:38.051908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:37 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.050 Sep 25 00:48:40.003794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:38 started Sep 25 00:48:40.008022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dccf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=732000000,duration_sec=82,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:40.008729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:48:40.009197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:38 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 00:48:42.004689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:39 started Sep 25 00:48:42.009480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcd1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=735000000,duration_sec=84,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:42.010712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:48:42.011755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:39 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 00:48:44.005856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:40 started Sep 25 00:48:44.009545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcd3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=735000000,duration_sec=86,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:44.010193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:48:44.010553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:40 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:48:46.006856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:41 started Sep 25 00:48:46.010135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcd5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=736000000,duration_sec=88,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:46.010708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:48:46.011064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:41 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:48:48.007799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:42 started Sep 25 00:48:48.012230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcd7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=738000000,duration_sec=90,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:48.013728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:48:48.015938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:42 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 00:48:50.010348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:43 started Sep 25 00:48:50.013500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcd9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=739000000,duration_sec=92,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:50.014603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:48:50.015340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:43 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:48:52.012390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:44 started Sep 25 00:48:52.015192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcdb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=741000000,duration_sec=94,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:52.015852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:48:52.016385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:44 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:48:54.013318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:45 started Sep 25 00:48:54.016099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcdd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=742000000,duration_sec=96,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:54.017327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:48:54.018160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:45 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:48:56.014751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:46 started Sep 25 00:48:56.017452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcdf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=743000000,duration_sec=98,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:56.018304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:48:56.018878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:46 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:48:58.016336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:47 started Sep 25 00:48:58.029015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dce1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=746000000,duration_sec=100,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:48:58.032367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:48:58.032729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:47 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Sep 25 00:49:00.017653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:48 started Sep 25 00:49:00.020490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dce3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=746000000,duration_sec=102,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:49:00.021060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:49:00.021521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:48 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:49:02.019520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:49 started Sep 25 00:49:02.029201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dce5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=750000000,duration_sec=104,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:49:02.029958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:49:02.030386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:49 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 25 00:49:04.021076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:50 started Sep 25 00:49:04.028725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dce7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=754000000,duration_sec=106,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:49:04.029342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:49:04.029870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:50 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 25 00:49:06.022236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:51 started Sep 25 00:49:06.024704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dce9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=751000000,duration_sec=108,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:49:06.025402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:49:06.025842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:51 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:49:08.023981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:52 started Sep 25 00:49:08.026511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dceb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=752000000,duration_sec=110,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:49:08.027179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:49:08.027578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:52 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:49:10.025115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:53 started Sep 25 00:49:10.027690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dced,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=753000000,duration_sec=112,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:49:10.028262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:49:10.028631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:53 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:49:12.026937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:54 started Sep 25 00:49:12.029724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcef,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=756000000,duration_sec=114,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:49:12.030294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:49:12.030648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:54 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:49:14.027830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:55 started Sep 25 00:49:14.030396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcf1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=756000000,duration_sec=116,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:49:14.030957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:49:14.031308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:55 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:49:16.028483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:56 started Sep 25 00:49:16.031141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcf3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=757000000,duration_sec=118,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:49:16.031703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:49:16.032057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:56 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:49:18.029896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:57 started Sep 25 00:49:18.033101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcf5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=758000000,duration_sec=120,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:49:18.033742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:49:18.034143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:57 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:49:20.031438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:58 started Sep 25 00:49:20.034462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcf7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=760000000,duration_sec=122,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:49:20.035061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:49:20.035425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:58 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:49:22.032399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:59 started Sep 25 00:49:22.035146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcf9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=761000000,duration_sec=124,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:49:22.035719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:49:22.036093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:59 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:49:24.033370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:60 started Sep 25 00:49:24.037412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcfb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=762000000,duration_sec=126,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:49:24.038153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:49:24.038650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:60 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 00:49:26.034653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:61 started Sep 25 00:49:26.038232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcfd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=763000000,duration_sec=128,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:49:26.038922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:49:26.039316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:61 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:49:28.035574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:62 started Sep 25 00:49:28.041103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dcff,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=765000000,duration_sec=130,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:49:28.042385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:49:28.042901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:62 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 25 00:49:30.037220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:63 started Sep 25 00:49:30.040574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd01,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=766000000,duration_sec=132,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:49:30.041342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:49:30.041745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:63 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:49:32.038643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:64 started Sep 25 00:49:32.041068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd03,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=767000000,duration_sec=134,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:49:32.041804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:49:32.042160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:64 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:49:34.039484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:65 started Sep 25 00:49:34.042102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd05,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=768000000,duration_sec=136,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:49:34.042663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:49:34.043020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:65 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:49:36.040091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:66 started Sep 25 00:49:36.042517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd07,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=768000000,duration_sec=138,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:49:36.043082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:49:36.043434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:66 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:49:38.041501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:67 started Sep 25 00:49:38.044009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd09,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=770000000,duration_sec=140,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:49:38.044587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:49:38.044941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:67 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:49:40.043471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:68 started Sep 25 00:49:40.046815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd0b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=772000000,duration_sec=142,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:49:40.047640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:49:40.048194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:68 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:49:42.044208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:69 started Sep 25 00:49:42.046726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd0d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=773000000,duration_sec=144,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:49:42.047292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:49:42.047650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:69 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:49:43.585580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e91bdc85-97fc-46ac-b794-5484bd927e92 admin admin] Resource Subnet d5743fda-09f8-4431-b8e1-5a0f79780c1c updated (revision_number 0->1). Old fields: {'dns_nameservers': []} New fields: {'dns_nameservers': [DNSNameServer(address='8.8.8.8',order=0,subnet_id=d5743fda-09f8-4431-b8e1-5a0f79780c1c), DNSNameServer(address='8.8.4.4',order=1,subnet_id=d5743fda-09f8-4431-b8e1-5a0f79780c1c)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:49:43.585580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e91bdc85-97fc-46ac-b794-5484bd927e92 admin admin] Publish callbacks [] for Subnet (d5743fda-09f8-4431-b8e1-5a0f79780c1c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:49:44.045581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:70 started Sep 25 00:49:44.048361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd0f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=774000000,duration_sec=146,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:49:44.049473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:49:44.049988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:70 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:49:46.046767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:71 started Sep 25 00:49:46.049128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd11,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=775000000,duration_sec=148,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:49:46.049724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:49:46.050084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:71 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:49:48.048366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:72 started Sep 25 00:49:48.050956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd13,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=777000000,duration_sec=150,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:49:48.051548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:49:48.051908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:72 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:49:50.049993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:73 started Sep 25 00:49:50.052427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd15,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=778000000,duration_sec=152,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:49:50.053277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:49:50.053649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:73 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:49:52.051587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:74 started Sep 25 00:49:52.054754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd17,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=780000000,duration_sec=154,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:49:52.055354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:49:52.055723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:74 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:49:54.053020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:75 started Sep 25 00:49:54.056200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd19,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=782000000,duration_sec=156,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:49:54.057019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:49:54.057675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:75 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:49:56.054670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:76 started Sep 25 00:49:56.057202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd1b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=783000000,duration_sec=158,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:49:56.057984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:49:56.058428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:76 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:49:58.056141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:77 started Sep 25 00:49:58.058964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd1d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=785000000,duration_sec=160,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:49:58.061496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:49:58.061496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:77 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:50:00.057198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:78 started Sep 25 00:50:00.059954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd1f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=786000000,duration_sec=162,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:00.060550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:50:00.060924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:78 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:50:02.058343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:79 started Sep 25 00:50:02.062749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd21,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=787000000,duration_sec=164,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:02.063343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:50:02.064108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:79 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 00:50:04.060151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:80 started Sep 25 00:50:04.065197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd23,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=790000000,duration_sec=166,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:04.066066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:50:04.066652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:80 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 00:50:06.060832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:81 started Sep 25 00:50:06.063417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd25,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=789000000,duration_sec=168,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:06.064026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:50:06.064458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:81 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:50:08.062023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:82 started Sep 25 00:50:08.065350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd27,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=791000000,duration_sec=170,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:08.066165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:50:08.068517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:82 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:50:10.063213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:83 started Sep 25 00:50:10.065840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd29,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=792000000,duration_sec=172,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:10.066413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:50:10.066780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:83 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:50:12.064065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:84 started Sep 25 00:50:12.066964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd2b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=792000000,duration_sec=174,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:12.067729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:50:12.067898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:84 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:50:14.065365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:85 started Sep 25 00:50:14.070367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd2d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=795000000,duration_sec=176,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:14.071501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:50:14.072147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:85 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 00:50:16.066487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:86 started Sep 25 00:50:16.069597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd2f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=795000000,duration_sec=178,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:16.070183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:50:16.070579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:86 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:50:18.067988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:87 started Sep 25 00:50:18.071158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd31,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=797000000,duration_sec=180,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:18.071876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:50:18.072303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:87 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:50:20.068918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:88 started Sep 25 00:50:20.071513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd33,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=797000000,duration_sec=182,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:20.072325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:50:20.072752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:88 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:50:22.070226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:89 started Sep 25 00:50:22.073239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd35,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=799000000,duration_sec=184,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:22.073890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:50:22.074325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:89 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:50:24.072490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:90 started Sep 25 00:50:24.078087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd37,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=803000000,duration_sec=186,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:24.079267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:50:24.079581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:90 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 00:50:26.073309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:91 started Sep 25 00:50:26.075840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd39,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=802000000,duration_sec=188,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:26.076423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:50:26.077006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:91 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:50:28.074239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:92 started Sep 25 00:50:28.076807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd3b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=803000000,duration_sec=190,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:28.077408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:50:28.077756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:92 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:50:30.075112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:93 started Sep 25 00:50:30.078376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd3d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=804000000,duration_sec=192,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:30.078738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:50:30.079164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:93 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:50:32.076510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:94 started Sep 25 00:50:32.078963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd3f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=805000000,duration_sec=194,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:32.079537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:50:32.079972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:94 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:50:34.077525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:95 started Sep 25 00:50:34.079957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd41,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=806000000,duration_sec=196,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:34.080519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:50:34.080870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:95 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:50:36.078419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:96 started Sep 25 00:50:36.081032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd43,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=807000000,duration_sec=198,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:36.081636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:50:36.082555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:96 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:50:38.080022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:97 started Sep 25 00:50:38.083033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd45,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=808000000,duration_sec=200,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:38.083601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:50:38.083979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:97 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:50:40.081844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:98 started Sep 25 00:50:40.084484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd47,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=810000000,duration_sec=202,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:40.085092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:50:40.085486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:98 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:50:42.083007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:99 started Sep 25 00:50:42.085409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd49,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=811000000,duration_sec=204,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:42.085958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:50:42.086302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:99 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:50:44.083765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:100 started Sep 25 00:50:44.086498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd4b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=812000000,duration_sec=206,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:44.087085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:50:44.087431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:100 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:50:46.084411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:101 started Sep 25 00:50:46.087341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd4d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=813000000,duration_sec=208,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:46.087941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:50:46.088299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:101 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:50:46.305533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c12cc3ec-cb35-42a3-984b-5d810b7376ad admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-25T00:50:46Z,description='',dns_domain=None,id=0a266287-67c4-4fb0-b8ee-993368d9faa7,mtu=1500,name='shared',project_id='c8e32a9668254c2e96354fd797883364',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(0a266287-67c4-4fb0-b8ee-993368d9faa7),segments=[NetworkSegment(31da2104-1e9b-4471-a650-0e5a617146c2)],shared=False,status='ACTIVE',updated_at=2022-09-25T00:50:46Z,vlan_transparent=) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:50:46.306009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c12cc3ec-cb35-42a3-984b-5d810b7376ad admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (0a266287-67c4-4fb0-b8ee-993368d9faa7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:50:46.481494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager [None req-c12cc3ec-cb35-42a3-984b-5d810b7376ad admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 0a266287-67c4-4fb0-b8ee-993368d9faa7 with segmentation id not found. Sep 25 00:50:46.481494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 25 00:50:46.481494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 25 00:50:46.481494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 25 00:50:46.481494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 25 00:50:46.481494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 25 00:50:46.481494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 25 00:50:46.481494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 25 00:50:46.481494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 25 00:50:46.481494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 25 00:50:46.481494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 25 00:50:46.481494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 25 00:50:46.481494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 25 00:50:46.482498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 25 00:50:46.482498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 25 00:50:46.482498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 25 00:50:46.482498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 0a266287-67c4-4fb0-b8ee-993368d9faa7 with segmentation id not found. Sep 25 00:50:46.482498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Sep 25 00:50:48.085937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:102 started Sep 25 00:50:48.088499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd4f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=814000000,duration_sec=210,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:48.089067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:50:48.089462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:102 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:50:49.730195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b20b7051-0d2a-46eb-9102-fe11f1cfc1b3 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(4cfdac6f-029d-41b9-9dc4-cf5de5669d09)],cidr=192.168.233.0/24,created_at=2022-09-25T00:50:49Z,description='shared-subnet',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=192.168.233.1,host_routes=[],id=21cd5562-25ed-4f98-be7e-91442190ddf5,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='shared-subnet',network_id=0a266287-67c4-4fb0-b8ee-993368d9faa7,project_id='c8e32a9668254c2e96354fd797883364',revision_number=0,segment_id=,service_types=[],shared=True,subnetpool_id=,updated_at=2022-09-25T00:50:49Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:50:49.730827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b20b7051-0d2a-46eb-9102-fe11f1cfc1b3 admin admin] Publish callbacks [] for Subnet (21cd5562-25ed-4f98-be7e-91442190ddf5), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:50:50.087152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:103 started Sep 25 00:50:50.089992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd51,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=816000000,duration_sec=212,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:50.090569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:50:50.090929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:103 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:50:50.270636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-20b8df9a-78e6-47b0-b18a-cde94f6345fb None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:50:49Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-0a266287-67c4-4fb0-b8ee-993368d9faa7',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da,mac_address=fa:16:3e:85:b4:6f,name='',network_id=0a266287-67c4-4fb0-b8ee-993368d9faa7,numa_affinity_policy=,project_id='c8e32a9668254c2e96354fd797883364',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:50:50Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:50:50.271674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-20b8df9a-78e6-47b0-b18a-cde94f6345fb None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:50:50.523849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-20b8df9a-78e6-47b0-b18a-cde94f6345fb None None] Resource Port ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da,segment=NetworkSegment(31da2104-1e9b-4471-a650-0e5a617146c2),segment_id=31da2104-1e9b-4471-a650-0e5a617146c2)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:50:50.524502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-20b8df9a-78e6-47b0-b18a-cde94f6345fb None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:50:50.617401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["134db280-e502-4aa4-a5aa-608326482310","insert","tapac4a2bd7-6e",["set",[]],["map",[["attached-mac","fa:16:3e:85:b4:6f"],["iface-id","ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:50:50.631306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["134db280-e502-4aa4-a5aa-608326482310","old",null,["set",[]],null],["","new","tapac4a2bd7-6e",5,["map",[["attached-mac","fa:16:3e:85:b4:6f"],["iface-id","ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:50:51.687548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b1618ddf-4e0e-4f64-aaa6-a9e19f3f22b1 None None] Resource Port ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:50:51.688214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b1618ddf-4e0e-4f64-aaa6-a9e19f3f22b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:50:52.088478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:104 started Sep 25 00:50:52.090886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd53,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=817000000,duration_sec=214,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:52.091458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:50:52.091930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:104 - starting polling. Elapsed:0.004 Sep 25 00:50:52.093203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:50:52.094560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:104 - port information retrieved. Elapsed:0.006 Sep 25 00:50:52.094890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '5204c0c3-4410-4695-a405-b599292c4e80', 'de4727a2-569d-44c6-a53e-ecc89817f610', 'fa672580-39eb-4bef-ac5b-6be835c6c88c'}, 'added': {'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da'}, 'removed': set(), 'updated': {'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:50:52.095463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-0a266287-67c4-4fb0-b8ee-993368d9faa7', 'network_id': '0a266287-67c4-4fb0-b8ee-993368d9faa7', 'port_id': 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', 'mac_address': 'fa:16:3e:85:b4:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 77, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '21cd5562-25ed-4f98-be7e-91442190ddf5', 'ip_address': '192.168.233.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:50:52.096747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:50:52.097242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da updated. Details: {'device': 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-0a266287-67c4-4fb0-b8ee-993368d9faa7', 'network_id': '0a266287-67c4-4fb0-b8ee-993368d9faa7', 'port_id': 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', 'mac_address': 'fa:16:3e:85:b4:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 77, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '21cd5562-25ed-4f98-be7e-91442190ddf5', 'ip_address': '192.168.233.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 25 00:50:52.097817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Assigning 3 as local vlan for net-id=0a266287-67c4-4fb0-b8ee-993368d9faa7, seg-id=77 Sep 25 00:50:52.100668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xa5d7ab3a,OFPFlowMod(buffer_id=4294967295,command=0,cookie=13979250796582379444,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4173), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4099}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:52.103013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x7834dd55,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4099)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4173}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:52.104191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapac4a2bd7-6e, col_values=(('tag', 3),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:50:52.104635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapac4a2bd7-6e, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:50:52.105081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapac4a2bd7-6e, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:50:52.110258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapac4a2bd7-6e, col_values=(('other_config', {'net_uuid': '0a266287-67c4-4fb0-b8ee-993368d9faa7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '3', 'segmentation_id': '77'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:50:52.117974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834dd57,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 5}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:52.118331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:104 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 4 devices currently available. Time elapsed: 0.023 Sep 25 00:50:52.118688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing device filters for 1 new devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 25 00:50:52.118995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing filters for devices {'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da'} Sep 25 00:50:52.120144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:50:52.120428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:50:52.122594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:50:52.160889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c71666-cbc9-40f3-8045-93dfe5f3c2d1]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:50:52.161564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:104 - agent port security group processed in 0.066 Sep 25 00:50:52.162255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:50:52.311253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da'] and devices down [] completed. Sep 25 00:50:52.311641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:104 - ports processed. Elapsed:0.223 Sep 25 00:50:52.312048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:104 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.224 Sep 25 00:50:54.089948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:105 started Sep 25 00:50:54.092431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd59,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=818000000,duration_sec=216,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:54.093007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:50:54.093396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:105 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:50:56.091250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:106 started Sep 25 00:50:56.093991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd5b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=820000000,duration_sec=218,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:56.094570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:50:56.094927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:106 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:50:58.092741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:107 started Sep 25 00:50:58.095217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd5d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=821000000,duration_sec=220,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:50:58.095981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:50:58.096335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:107 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:51:00.094204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:108 started Sep 25 00:51:00.096804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd5f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=822000000,duration_sec=222,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:51:00.097474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:51:00.097826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:108 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:51:02.095034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:109 started Sep 25 00:51:02.098398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd61,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=823000000,duration_sec=224,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:51:02.098963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:51:02.099320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:109 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:51:04.096566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:110 started Sep 25 00:51:04.106112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd63,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=825000000,duration_sec=226,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:51:04.106926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:51:04.107335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:110 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 25 00:51:06.097815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:111 started Sep 25 00:51:06.100263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd65,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=826000000,duration_sec=228,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:51:06.100863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:51:06.101221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:111 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:51:08.098922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:112 started Sep 25 00:51:08.101671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd67,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=827000000,duration_sec=230,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:51:08.102290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:51:08.102640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:112 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:51:10.099934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:113 started Sep 25 00:51:10.102431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd69,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=828000000,duration_sec=232,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:51:10.103056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:51:10.103436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:113 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:51:12.101049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:114 started Sep 25 00:51:12.104101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd6b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=830000000,duration_sec=234,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:51:12.105244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:51:12.105692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:114 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:51:14.102517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:115 started Sep 25 00:51:14.105403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd6d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=831000000,duration_sec=236,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:51:14.106062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:51:14.106499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:115 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:51:16.104168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:116 started Sep 25 00:51:16.107504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd6f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=833000000,duration_sec=238,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:51:16.108310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:51:16.108762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:116 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:51:18.104925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:117 started Sep 25 00:51:18.107706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd71,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=833000000,duration_sec=240,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:51:18.108305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:51:18.108811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:117 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:51:20.105525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:118 started Sep 25 00:51:20.108377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd73,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=834000000,duration_sec=242,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:51:20.109115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:51:20.109652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:118 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:51:22.106684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:119 started Sep 25 00:51:22.109198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd75,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=835000000,duration_sec=244,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:51:22.109831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:51:22.110188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:119 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:51:24.107766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:120 started Sep 25 00:51:24.110442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd77,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=836000000,duration_sec=246,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:51:24.111066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:51:24.111429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:120 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:51:26.109075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:121 started Sep 25 00:51:26.112126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd79,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=838000000,duration_sec=248,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:51:26.113410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:51:26.113691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:121 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:51:28.109867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:122 started Sep 25 00:51:28.113842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd7b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=838000000,duration_sec=250,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:51:28.114599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:51:28.115040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:122 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:51:30.111017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:123 started Sep 25 00:51:30.115872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd7d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=842000000,duration_sec=252,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:51:30.116526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:51:30.116960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:123 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 00:51:32.111986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:124 started Sep 25 00:51:32.115173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd7f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=840000000,duration_sec=254,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:51:32.115794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:51:32.116154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:124 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:51:34.113403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:125 started Sep 25 00:51:34.116304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd81,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=842000000,duration_sec=256,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:51:34.117018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:51:34.117519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:125 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:51:36.114504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:126 started Sep 25 00:51:36.117559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd83,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=843000000,duration_sec=258,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:51:36.118216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:51:36.118658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:126 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:51:38.115913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:127 started Sep 25 00:51:38.119328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd85,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=845000000,duration_sec=260,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:51:38.120131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:51:38.120543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:127 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:51:40.118081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:128 started Sep 25 00:51:40.121208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd87,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=847000000,duration_sec=262,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:51:40.121878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:51:40.122248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:128 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:51:42.118481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:129 started Sep 25 00:51:42.121996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd89,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=848000000,duration_sec=264,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:51:42.122898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:51:42.123363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:129 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:51:44.119174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:130 started Sep 25 00:51:44.123528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd8b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=848000000,duration_sec=266,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:51:44.124211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:51:44.124642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:130 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 00:51:46.120974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:131 started Sep 25 00:51:46.130342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd8d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=850000000,duration_sec=268,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:51:46.131087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:51:46.131522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:131 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 25 00:51:48.122153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:132 started Sep 25 00:51:48.124689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd8f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=851000000,duration_sec=270,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:51:48.125293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:51:48.125659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:132 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:51:50.123502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:133 started Sep 25 00:51:50.126008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd91,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=852000000,duration_sec=272,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:51:50.126591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:51:50.126955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:133 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:51:52.124561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:134 started Sep 25 00:51:52.127350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd93,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=853000000,duration_sec=274,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:51:52.127957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:51:52.128315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:134 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:51:54.125876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:135 started Sep 25 00:51:54.128972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd95,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=855000000,duration_sec=276,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:51:54.129616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:51:54.130000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:135 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:51:56.127676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:136 started Sep 25 00:51:56.130694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd97,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=856000000,duration_sec=278,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:51:56.131293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:51:56.131650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:136 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:51:58.129611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:137 started Sep 25 00:51:58.132503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd99,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=858000000,duration_sec=280,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:51:58.133143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:51:58.133718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:137 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:52:00.130027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:138 started Sep 25 00:52:00.134073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd9b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=859000000,duration_sec=282,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:52:00.134995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:52:00.135414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:138 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 00:52:02.130408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:139 started Sep 25 00:52:02.133345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd9d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=859000000,duration_sec=284,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:52:02.133914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:52:02.134270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:139 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:52:04.131019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:140 started Sep 25 00:52:04.135082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dd9f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=860000000,duration_sec=286,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:52:04.135720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:52:04.136089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:140 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:52:06.131978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:141 started Sep 25 00:52:06.134540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dda1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=860000000,duration_sec=288,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:52:06.135227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:52:06.135630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:141 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:52:08.133609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:142 started Sep 25 00:52:08.136398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dda3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=862000000,duration_sec=290,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:52:08.137057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:52:08.137553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:142 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:52:09.228932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c52d6540-ea6c-483a-bc63-b2ab0e651d97 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:52:09Z,description='Default security group',id=e8a29900-889a-4a84-8f2e-256b839ca598,is_default=True,name='default',project_id='e185fae5d18d43bd846f04c42cfbee1e',revision_number=1,rules=[SecurityGroupRule(124a2b81-b2f0-4ec8-8766-36f14e5ce37d),SecurityGroupRule(3ac21729-bafe-4df9-aa80-833eb97cf5eb),SecurityGroupRule(427fa085-5d7b-474c-9ed5-c96ae68d02a3),SecurityGroupRule(8e2a4748-4516-4793-a364-fcda6c990d44)],shared=False,stateful=True,updated_at=2022-09-25T00:52:09Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:52:09.229665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c52d6540-ea6c-483a-bc63-b2ab0e651d97 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (e8a29900-889a-4a84-8f2e-256b839ca598), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:52:09.230366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c52d6540-ea6c-483a-bc63-b2ab0e651d97 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:52:09Z,description=,direction='ingress',ethertype='IPv6',id=124a2b81-b2f0-4ec8-8766-36f14e5ce37d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e185fae5d18d43bd846f04c42cfbee1e',protocol=,remote_address_group_id=,remote_group_id=e8a29900-889a-4a84-8f2e-256b839ca598,remote_ip_prefix=,revision_number=0,security_group_id=e8a29900-889a-4a84-8f2e-256b839ca598,updated_at=2022-09-25T00:52:09Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:52:09.230827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c52d6540-ea6c-483a-bc63-b2ab0e651d97 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (124a2b81-b2f0-4ec8-8766-36f14e5ce37d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:52:09.231282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c52d6540-ea6c-483a-bc63-b2ab0e651d97 admin admin] Security group rule updated ['e8a29900-889a-4a84-8f2e-256b839ca598'] Sep 25 00:52:09.232225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c52d6540-ea6c-483a-bc63-b2ab0e651d97 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:52:09Z,description=,direction='egress',ethertype='IPv6',id=3ac21729-bafe-4df9-aa80-833eb97cf5eb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e185fae5d18d43bd846f04c42cfbee1e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e8a29900-889a-4a84-8f2e-256b839ca598,updated_at=2022-09-25T00:52:09Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:52:09.232656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c52d6540-ea6c-483a-bc63-b2ab0e651d97 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (3ac21729-bafe-4df9-aa80-833eb97cf5eb), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:52:09.233069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c52d6540-ea6c-483a-bc63-b2ab0e651d97 admin admin] Security group rule updated ['e8a29900-889a-4a84-8f2e-256b839ca598'] Sep 25 00:52:09.233863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c52d6540-ea6c-483a-bc63-b2ab0e651d97 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:52:09Z,description=,direction='egress',ethertype='IPv4',id=427fa085-5d7b-474c-9ed5-c96ae68d02a3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e185fae5d18d43bd846f04c42cfbee1e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e8a29900-889a-4a84-8f2e-256b839ca598,updated_at=2022-09-25T00:52:09Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:52:09.234290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c52d6540-ea6c-483a-bc63-b2ab0e651d97 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (427fa085-5d7b-474c-9ed5-c96ae68d02a3), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:52:09.234709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c52d6540-ea6c-483a-bc63-b2ab0e651d97 admin admin] Security group rule updated ['e8a29900-889a-4a84-8f2e-256b839ca598'] Sep 25 00:52:09.236122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c52d6540-ea6c-483a-bc63-b2ab0e651d97 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:52:09Z,description=,direction='ingress',ethertype='IPv4',id=8e2a4748-4516-4793-a364-fcda6c990d44,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e185fae5d18d43bd846f04c42cfbee1e',protocol=,remote_address_group_id=,remote_group_id=e8a29900-889a-4a84-8f2e-256b839ca598,remote_ip_prefix=,revision_number=0,security_group_id=e8a29900-889a-4a84-8f2e-256b839ca598,updated_at=2022-09-25T00:52:09Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:52:09.236675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c52d6540-ea6c-483a-bc63-b2ab0e651d97 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (8e2a4748-4516-4793-a364-fcda6c990d44), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:52:09.237017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c52d6540-ea6c-483a-bc63-b2ab0e651d97 admin admin] Security group rule updated ['e8a29900-889a-4a84-8f2e-256b839ca598'] Sep 25 00:52:09.448276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2f118fe8-290a-428c-bf0f-a9a8b7a2a8e2 admin admin] Resource SecurityGroup deleted: e8a29900-889a-4a84-8f2e-256b839ca598 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:52:09.449078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2f118fe8-290a-428c-bf0f-a9a8b7a2a8e2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (e8a29900-889a-4a84-8f2e-256b839ca598), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:52:09.449458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f118fe8-290a-428c-bf0f-a9a8b7a2a8e2 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e8a29900-889a-4a84-8f2e-256b839ca598',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:52:09.470706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2f118fe8-290a-428c-bf0f-a9a8b7a2a8e2 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e8a29900-889a-4a84-8f2e-256b839ca598',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:52:09.471404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2f118fe8-290a-428c-bf0f-a9a8b7a2a8e2 admin admin] Resource SecurityGroupRule deleted: 124a2b81-b2f0-4ec8-8766-36f14e5ce37d {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:52:09.471896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2f118fe8-290a-428c-bf0f-a9a8b7a2a8e2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (124a2b81-b2f0-4ec8-8766-36f14e5ce37d), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:52:09.472300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2f118fe8-290a-428c-bf0f-a9a8b7a2a8e2 admin admin] Security group rule updated ['e8a29900-889a-4a84-8f2e-256b839ca598'] Sep 25 00:52:09.472792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2f118fe8-290a-428c-bf0f-a9a8b7a2a8e2 admin admin] Resource SecurityGroupRule deleted: 3ac21729-bafe-4df9-aa80-833eb97cf5eb {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:52:09.473249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2f118fe8-290a-428c-bf0f-a9a8b7a2a8e2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (3ac21729-bafe-4df9-aa80-833eb97cf5eb), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:52:09.473775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2f118fe8-290a-428c-bf0f-a9a8b7a2a8e2 admin admin] Security group rule updated ['e8a29900-889a-4a84-8f2e-256b839ca598'] Sep 25 00:52:09.474253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2f118fe8-290a-428c-bf0f-a9a8b7a2a8e2 admin admin] Resource SecurityGroupRule deleted: 427fa085-5d7b-474c-9ed5-c96ae68d02a3 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:52:09.474726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2f118fe8-290a-428c-bf0f-a9a8b7a2a8e2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (427fa085-5d7b-474c-9ed5-c96ae68d02a3), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:52:09.475182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2f118fe8-290a-428c-bf0f-a9a8b7a2a8e2 admin admin] Security group rule updated ['e8a29900-889a-4a84-8f2e-256b839ca598'] Sep 25 00:52:09.475809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2f118fe8-290a-428c-bf0f-a9a8b7a2a8e2 admin admin] Resource SecurityGroupRule deleted: 8e2a4748-4516-4793-a364-fcda6c990d44 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:52:09.476249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2f118fe8-290a-428c-bf0f-a9a8b7a2a8e2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (8e2a4748-4516-4793-a364-fcda6c990d44), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:52:09.476666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2f118fe8-290a-428c-bf0f-a9a8b7a2a8e2 admin admin] Security group rule updated ['e8a29900-889a-4a84-8f2e-256b839ca598'] Sep 25 00:52:10.134540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:143 started Sep 25 00:52:10.141468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dda5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=867000000,duration_sec=292,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:52:10.142204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:52:10.142568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:143 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 25 00:52:12.135856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:144 started Sep 25 00:52:12.138310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dda7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=864000000,duration_sec=294,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:52:12.138964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:52:12.139318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:144 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:52:14.137324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:145 started Sep 25 00:52:14.139788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dda9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=866000000,duration_sec=296,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:52:14.140359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:52:14.140707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:145 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:52:16.138921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:146 started Sep 25 00:52:16.141478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddab,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=867000000,duration_sec=298,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:52:16.142560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:52:16.142560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:146 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:52:18.139801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:147 started Sep 25 00:52:18.142526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddad,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=868000000,duration_sec=300,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:52:18.143215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:52:18.143572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:147 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:52:20.140629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:148 started Sep 25 00:52:20.143304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddaf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=869000000,duration_sec=302,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:52:20.143833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:52:20.144215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:148 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:52:22.142002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:149 started Sep 25 00:52:22.144600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddb1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=870000000,duration_sec=304,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:52:22.145190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:52:22.145572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:149 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:52:24.142574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:150 started Sep 25 00:52:24.145111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddb3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=871000000,duration_sec=306,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:52:24.145730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:52:24.146080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:150 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:52:26.143397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:151 started Sep 25 00:52:26.145861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddb5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=872000000,duration_sec=308,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:52:26.146432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:52:26.146780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:151 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:52:28.144666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:152 started Sep 25 00:52:28.147352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddb7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=873000000,duration_sec=310,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:52:28.148076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:52:28.148469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:152 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:52:30.146005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:153 started Sep 25 00:52:30.148432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddb9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=874000000,duration_sec=312,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:52:30.149015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:52:30.149395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:153 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:52:32.147257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:154 started Sep 25 00:52:32.149924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddbb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=876000000,duration_sec=314,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:52:32.150498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:52:32.150852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:154 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:52:34.147837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:155 started Sep 25 00:52:34.150289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddbd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=876000000,duration_sec=316,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:52:34.150913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:52:34.151268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:155 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:52:36.148573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:156 started Sep 25 00:52:36.151115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddbf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=877000000,duration_sec=318,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:52:36.151680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:52:36.152056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:156 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:52:38.149282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:157 started Sep 25 00:52:38.151707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddc1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=878000000,duration_sec=320,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:52:38.152278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:52:38.152672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:157 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:52:40.150560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:158 started Sep 25 00:52:40.153357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddc3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=879000000,duration_sec=322,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:52:40.153927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:52:40.154278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:158 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:52:42.151051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:159 started Sep 25 00:52:42.153542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddc5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=879000000,duration_sec=324,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:52:42.154130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:52:42.154488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:159 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:52:44.151827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:160 started Sep 25 00:52:44.154372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddc7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=880000000,duration_sec=326,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:52:44.154944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:52:44.155288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:160 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:52:46.152698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:161 started Sep 25 00:52:46.155142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddc9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=881000000,duration_sec=328,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:52:46.155705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:52:46.156053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:161 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:52:48.154015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:162 started Sep 25 00:52:48.156965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddcb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=882000000,duration_sec=330,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:52:48.157590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:52:48.157945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:162 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:52:50.155341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:163 started Sep 25 00:52:50.158588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddcd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=884000000,duration_sec=332,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:52:50.159158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:52:50.159508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:163 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:52:52.155850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:164 started Sep 25 00:52:52.158835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddcf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=885000000,duration_sec=334,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:52:52.159409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:52:52.159763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:164 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:52:54.157194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:165 started Sep 25 00:52:54.159764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddd1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=886000000,duration_sec=336,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:52:54.160377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:52:54.160736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:165 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:52:56.158263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:166 started Sep 25 00:52:56.161296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddd3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=887000000,duration_sec=338,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:52:56.161981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:52:56.162418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:166 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:52:58.158904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:167 started Sep 25 00:52:58.161581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddd5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=887000000,duration_sec=340,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:52:58.162207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:52:58.162565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:167 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:53:00.160348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:168 started Sep 25 00:53:00.162806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddd7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=889000000,duration_sec=342,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:53:00.163377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:53:00.163725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:168 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:53:02.161683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:169 started Sep 25 00:53:02.164097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddd9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=890000000,duration_sec=344,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:53:02.164669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:53:02.165026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:169 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:53:04.162322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:170 started Sep 25 00:53:04.164882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dddb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=891000000,duration_sec=346,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:53:04.166200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:53:04.166565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:170 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:53:06.163337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:171 started Sep 25 00:53:06.166428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dddd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=892000000,duration_sec=348,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:53:06.167043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:53:06.167424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:171 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:53:08.164801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:172 started Sep 25 00:53:08.167181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dddf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=893000000,duration_sec=350,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:53:08.167740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:53:08.168086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:172 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 25 00:53:10.166325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:173 started Sep 25 00:53:10.168812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dde1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=895000000,duration_sec=352,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:53:10.169447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:53:10.169788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:173 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:53:12.166841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:174 started Sep 25 00:53:12.169165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dde3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=895000000,duration_sec=354,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:53:12.169788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:53:12.170131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:174 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 25 00:53:14.168012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:175 started Sep 25 00:53:14.170545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dde5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=896000000,duration_sec=356,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:53:14.171274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:53:14.171771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:175 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:53:16.169617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:176 started Sep 25 00:53:16.173062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dde7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=899000000,duration_sec=358,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:53:16.173761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:53:16.174117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:176 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:53:18.171803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:177 started Sep 25 00:53:18.174267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dde9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=900000000,duration_sec=360,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:53:18.174866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:53:18.175214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:177 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:53:20.173119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:178 started Sep 25 00:53:20.175561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddeb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=901000000,duration_sec=362,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:53:20.176126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:53:20.176475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:178 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:53:22.174214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:179 started Sep 25 00:53:22.176643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dded,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=903000000,duration_sec=364,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:53:22.177212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:53:22.177594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:179 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:53:24.175004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:180 started Sep 25 00:53:24.177435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddef,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=903000000,duration_sec=366,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:53:24.178010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:53:24.178368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:180 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:53:26.176001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:181 started Sep 25 00:53:26.178408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddf1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=904000000,duration_sec=368,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:53:26.178996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:53:26.179342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:181 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:53:28.177085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:182 started Sep 25 00:53:28.179588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddf3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=905000000,duration_sec=370,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:53:28.180158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:53:28.180507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:182 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:53:30.178208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:183 started Sep 25 00:53:30.180625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddf5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=907000000,duration_sec=372,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:53:30.181223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:53:30.181608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:183 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:53:32.178787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:184 started Sep 25 00:53:32.181713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddf7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=907000000,duration_sec=374,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:53:32.182363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:53:32.182802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:184 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:53:34.180016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:185 started Sep 25 00:53:34.186581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddf9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=908000000,duration_sec=376,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:53:34.187210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:53:34.187571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:185 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 25 00:53:36.181194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:186 started Sep 25 00:53:36.183674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddfb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=910000000,duration_sec=378,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:53:36.184253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:53:36.184604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:186 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:53:38.182220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:187 started Sep 25 00:53:38.184611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddfd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=911000000,duration_sec=380,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:53:38.185183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:53:38.185744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:187 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:53:40.183557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:188 started Sep 25 00:53:40.187029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ddff,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=912000000,duration_sec=382,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:53:40.187597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:53:40.187950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:188 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:53:42.184372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:189 started Sep 25 00:53:42.187313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de01,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=913000000,duration_sec=384,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:53:42.187877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:53:42.188223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:189 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:53:44.185521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:190 started Sep 25 00:53:44.188233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de03,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=914000000,duration_sec=386,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:53:44.189016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:53:44.189635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:190 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:53:46.186785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:191 started Sep 25 00:53:46.189187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de05,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=915000000,duration_sec=388,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:53:46.189785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:53:46.190137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:191 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:53:48.187572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:192 started Sep 25 00:53:48.190023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de07,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=916000000,duration_sec=390,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:53:48.190597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:53:48.190949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:192 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:53:50.188369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:193 started Sep 25 00:53:50.190791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de09,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=917000000,duration_sec=392,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:53:50.191384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:53:50.191733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:193 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:53:52.188837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:194 started Sep 25 00:53:52.191535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de0b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=917000000,duration_sec=394,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:53:52.192115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:53:52.192472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:194 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:53:54.190326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:195 started Sep 25 00:53:54.192781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de0d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=919000000,duration_sec=396,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:53:54.193390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:53:54.193749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:195 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:53:56.191381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:196 started Sep 25 00:53:56.193817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de0f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=920000000,duration_sec=398,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:53:56.194388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:53:56.194738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:196 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:53:58.192698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:197 started Sep 25 00:53:58.195195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de11,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=921000000,duration_sec=400,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:53:58.195784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:53:58.196130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:197 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:54:00.194012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:198 started Sep 25 00:54:00.196426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de13,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=922000000,duration_sec=402,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:54:00.196994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:54:00.197381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:198 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:54:02.194586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:199 started Sep 25 00:54:02.197044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de15,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=923000000,duration_sec=404,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:54:02.197778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:54:02.198138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:199 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:54:04.196012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:200 started Sep 25 00:54:04.199059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de17,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=925000000,duration_sec=406,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:54:04.199699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:54:04.200715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:200 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:54:06.197871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:201 started Sep 25 00:54:06.200309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de19,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=926000000,duration_sec=408,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:54:06.200888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:54:06.201241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:201 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:54:08.198518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:202 started Sep 25 00:54:08.201011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de1b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=927000000,duration_sec=410,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:54:08.201638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:54:08.201994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:202 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:54:10.199450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:203 started Sep 25 00:54:10.202551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de1d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=928000000,duration_sec=412,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:54:10.203117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:54:10.203501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:203 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:54:12.200403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:204 started Sep 25 00:54:12.203049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de1f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=929000000,duration_sec=414,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:54:12.203607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:54:12.203957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:204 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:54:14.201594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:205 started Sep 25 00:54:14.204063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de21,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=930000000,duration_sec=416,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:54:14.204645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:54:14.205005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:205 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:54:16.202145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:206 started Sep 25 00:54:16.204512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de23,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=930000000,duration_sec=418,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:54:16.205078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:54:16.205479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:206 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:54:18.202866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:207 started Sep 25 00:54:18.205388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de25,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=931000000,duration_sec=420,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:54:18.205958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:54:18.206307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:207 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:54:20.204326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:208 started Sep 25 00:54:20.206758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de27,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=933000000,duration_sec=422,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:54:20.207351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:54:20.207702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:208 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:54:22.205741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:209 started Sep 25 00:54:22.208063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de29,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=934000000,duration_sec=424,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:54:22.208699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:54:22.209053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:209 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:54:24.206946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:210 started Sep 25 00:54:24.209420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de2b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=935000000,duration_sec=426,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:54:24.209997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:54:24.210349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:210 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:54:26.207734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:211 started Sep 25 00:54:26.210226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de2d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=936000000,duration_sec=428,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:54:26.210801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:54:26.211155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:211 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:54:28.209113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:212 started Sep 25 00:54:28.211560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de2f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=937000000,duration_sec=430,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:54:28.212149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:54:28.212495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:212 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:54:30.209924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:213 started Sep 25 00:54:30.212290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de31,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=938000000,duration_sec=432,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:54:30.212866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:54:30.213222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:213 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:54:32.211201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:214 started Sep 25 00:54:32.214052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de33,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=939000000,duration_sec=434,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:54:32.214646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:54:32.215203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:214 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:54:34.212733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:215 started Sep 25 00:54:34.215975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de35,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=941000000,duration_sec=436,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:54:34.216487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:54:34.216841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:215 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:54:36.213898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:216 started Sep 25 00:54:36.216434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de37,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=942000000,duration_sec=438,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:54:36.217004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:54:36.217401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:216 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:54:38.215587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:217 started Sep 25 00:54:38.218473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de39,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=944000000,duration_sec=440,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:54:38.219131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:54:38.219560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:217 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:54:40.216319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:218 started Sep 25 00:54:40.218698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de3b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=945000000,duration_sec=442,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:54:40.219323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:54:40.219680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:218 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:54:42.217183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:219 started Sep 25 00:54:42.219590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de3d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=945000000,duration_sec=444,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:54:42.220153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:54:42.220507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:219 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:54:44.218707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:220 started Sep 25 00:54:44.221170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de3f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=947000000,duration_sec=446,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:54:44.221805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:54:44.222153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:220 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:54:46.219771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:221 started Sep 25 00:54:46.222232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de41,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=948000000,duration_sec=448,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:54:46.222805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:54:46.223156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:221 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:54:48.220606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:222 started Sep 25 00:54:48.223737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de43,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=949000000,duration_sec=450,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:54:48.224335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:54:48.224681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:222 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:54:50.222017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:223 started Sep 25 00:54:50.224518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de45,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=950000000,duration_sec=452,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:54:50.225093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:54:50.225490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:223 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:54:52.222789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:224 started Sep 25 00:54:52.225284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de47,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=951000000,duration_sec=454,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:54:52.225849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:54:52.226203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:224 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:54:54.224002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:225 started Sep 25 00:54:54.226659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de49,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=952000000,duration_sec=456,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:54:54.227226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:54:54.227588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:225 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:54:56.224975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:226 started Sep 25 00:54:56.227506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de4b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=953000000,duration_sec=458,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:54:56.228077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:54:56.228429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:226 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:54:58.226112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:227 started Sep 25 00:54:58.228740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de4d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=954000000,duration_sec=460,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:54:58.230027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:54:58.231059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:227 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:55:00.227734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:228 started Sep 25 00:55:00.231849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de4f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=957000000,duration_sec=462,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:00.232427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:55:00.232783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:228 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 00:55:02.228528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:229 started Sep 25 00:55:02.231734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de51,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=957000000,duration_sec=464,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:02.232240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:55:02.232607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:229 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:55:04.230120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:230 started Sep 25 00:55:04.232459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de53,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=958000000,duration_sec=466,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:04.233023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:55:04.233429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:230 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:55:06.231104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:231 started Sep 25 00:55:06.233573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de55,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=959000000,duration_sec=468,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:06.234149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:55:06.234504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:231 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:55:08.231820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:232 started Sep 25 00:55:08.234296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de57,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=960000000,duration_sec=470,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:08.234865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:55:08.235218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:232 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:55:10.232382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:233 started Sep 25 00:55:10.234870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de59,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=961000000,duration_sec=472,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:10.235463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:55:10.235842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:233 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:55:12.233704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:234 started Sep 25 00:55:12.236209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de5b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=962000000,duration_sec=474,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:12.236846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:55:12.237194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:234 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:55:14.234509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:235 started Sep 25 00:55:14.236998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de5d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=963000000,duration_sec=476,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:14.237595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:55:14.237952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:235 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:55:16.235573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:236 started Sep 25 00:55:16.238199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de5f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=964000000,duration_sec=478,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:16.239124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:55:16.239510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:236 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:55:18.237079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:237 started Sep 25 00:55:18.240993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de61,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=966000000,duration_sec=480,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:18.241842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:55:18.242478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:237 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:55:20.237991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:238 started Sep 25 00:55:20.240735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de63,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=967000000,duration_sec=482,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:20.241364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:55:20.241722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:238 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:55:22.239292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:239 started Sep 25 00:55:22.241848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de65,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=968000000,duration_sec=484,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:22.242417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:55:22.243065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:239 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:55:24.240737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:240 started Sep 25 00:55:24.243685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de67,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=969000000,duration_sec=486,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:24.244445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:55:24.244932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:240 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:55:26.242082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:241 started Sep 25 00:55:26.245555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de69,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=970000000,duration_sec=488,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:26.246118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:55:26.246466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:241 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:55:28.242715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:242 started Sep 25 00:55:28.246520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de6b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=971000000,duration_sec=490,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:28.247322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:55:28.247671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:242 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:55:30.244752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:243 started Sep 25 00:55:30.247239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de6d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=973000000,duration_sec=492,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:30.247813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:55:30.248166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:243 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:55:32.245014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:244 started Sep 25 00:55:32.247594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de6f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=973000000,duration_sec=494,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:32.248169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:55:32.248518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:244 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:55:34.245774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:245 started Sep 25 00:55:34.248137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de71,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=974000000,duration_sec=496,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:34.248698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:55:34.249050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:245 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:55:36.247221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:246 started Sep 25 00:55:36.273526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de73,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=976000000,duration_sec=498,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:36.273526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:55:36.273526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:246 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:55:38.248515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:247 started Sep 25 00:55:38.252823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de75,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=978000000,duration_sec=500,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:38.253662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:55:38.254226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:247 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 00:55:39.692290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-411fb971-9fb4-425e-8bcb-e8e5f6226229 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:55:39Z,description='Default security group',id=1dc05fbe-29d1-4128-a9ac-c675fde8a879,is_default=True,name='default',project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',revision_number=1,rules=[SecurityGroupRule(77a0adcd-19d4-46fa-90cb-887d9588b434),SecurityGroupRule(988c6c16-422a-4421-b3e3-fa3599885a8d),SecurityGroupRule(d2c78e94-634e-4bb4-b662-46eeb2901983),SecurityGroupRule(d63c7548-40c1-4a78-9f66-45cfe094faba)],shared=False,stateful=True,updated_at=2022-09-25T00:55:39Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:39.693360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-411fb971-9fb4-425e-8bcb-e8e5f6226229 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (1dc05fbe-29d1-4128-a9ac-c675fde8a879), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:39.694291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-411fb971-9fb4-425e-8bcb-e8e5f6226229 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:39Z,description=,direction='ingress',ethertype='IPv6',id=77a0adcd-19d4-46fa-90cb-887d9588b434,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',protocol=,remote_address_group_id=,remote_group_id=1dc05fbe-29d1-4128-a9ac-c675fde8a879,remote_ip_prefix=,revision_number=0,security_group_id=1dc05fbe-29d1-4128-a9ac-c675fde8a879,updated_at=2022-09-25T00:55:39Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:39.694824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-411fb971-9fb4-425e-8bcb-e8e5f6226229 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (77a0adcd-19d4-46fa-90cb-887d9588b434), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:39.695340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-411fb971-9fb4-425e-8bcb-e8e5f6226229 admin admin] Security group rule updated ['1dc05fbe-29d1-4128-a9ac-c675fde8a879'] Sep 25 00:55:39.696189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-411fb971-9fb4-425e-8bcb-e8e5f6226229 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:39Z,description=,direction='egress',ethertype='IPv6',id=988c6c16-422a-4421-b3e3-fa3599885a8d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1dc05fbe-29d1-4128-a9ac-c675fde8a879,updated_at=2022-09-25T00:55:39Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:39.697403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-411fb971-9fb4-425e-8bcb-e8e5f6226229 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (988c6c16-422a-4421-b3e3-fa3599885a8d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:39.697895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-411fb971-9fb4-425e-8bcb-e8e5f6226229 admin admin] Security group rule updated ['1dc05fbe-29d1-4128-a9ac-c675fde8a879'] Sep 25 00:55:39.698729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-411fb971-9fb4-425e-8bcb-e8e5f6226229 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:39Z,description=,direction='ingress',ethertype='IPv4',id=d2c78e94-634e-4bb4-b662-46eeb2901983,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',protocol=,remote_address_group_id=,remote_group_id=1dc05fbe-29d1-4128-a9ac-c675fde8a879,remote_ip_prefix=,revision_number=0,security_group_id=1dc05fbe-29d1-4128-a9ac-c675fde8a879,updated_at=2022-09-25T00:55:39Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:39.699251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-411fb971-9fb4-425e-8bcb-e8e5f6226229 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (d2c78e94-634e-4bb4-b662-46eeb2901983), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:39.702585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-411fb971-9fb4-425e-8bcb-e8e5f6226229 admin admin] Security group rule updated ['1dc05fbe-29d1-4128-a9ac-c675fde8a879'] Sep 25 00:55:39.703480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-411fb971-9fb4-425e-8bcb-e8e5f6226229 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:39Z,description=,direction='egress',ethertype='IPv4',id=d63c7548-40c1-4a78-9f66-45cfe094faba,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1dc05fbe-29d1-4128-a9ac-c675fde8a879,updated_at=2022-09-25T00:55:39Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:39.704158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-411fb971-9fb4-425e-8bcb-e8e5f6226229 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (d63c7548-40c1-4a78-9f66-45cfe094faba), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:39.705368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-411fb971-9fb4-425e-8bcb-e8e5f6226229 admin admin] Security group rule updated ['1dc05fbe-29d1-4128-a9ac-c675fde8a879'] Sep 25 00:55:39.918415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-411fb971-9fb4-425e-8bcb-e8e5f6226229 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-25T00:55:39Z,description='',dns_domain=None,id=5dc49b54-686c-4619-ad4c-65c72c26fd31,mtu=1500,name='tempest-AttachVolumeNegativeTest-521498035-network',project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(5dc49b54-686c-4619-ad4c-65c72c26fd31),segments=[NetworkSegment(32553459-8243-41b9-9fc0-bae9f5646e9f)],shared=False,status='ACTIVE',updated_at=2022-09-25T00:55:39Z,vlan_transparent=) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:39.918844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-411fb971-9fb4-425e-8bcb-e8e5f6226229 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (5dc49b54-686c-4619-ad4c-65c72c26fd31), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:40.030715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager [None req-411fb971-9fb4-425e-8bcb-e8e5f6226229 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 5dc49b54-686c-4619-ad4c-65c72c26fd31 with segmentation id not found. Sep 25 00:55:40.030715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 25 00:55:40.030715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 25 00:55:40.030715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 25 00:55:40.030715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 25 00:55:40.030715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 25 00:55:40.030715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 25 00:55:40.030715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 25 00:55:40.030715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 25 00:55:40.030715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 25 00:55:40.030715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 25 00:55:40.030715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 25 00:55:40.030715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 25 00:55:40.031719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 25 00:55:40.031719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 25 00:55:40.031719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 25 00:55:40.031719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 5dc49b54-686c-4619-ad4c-65c72c26fd31 with segmentation id not found. Sep 25 00:55:40.031719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Sep 25 00:55:40.250985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:248 started Sep 25 00:55:40.266734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de77,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=991000000,duration_sec=502,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:40.268783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:55:40.269404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:248 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.020 Sep 25 00:55:40.643693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3db039e0-13e5-4c13-b946-9e884984c67d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:55:40Z,description='Default security group',id=a82a09b8-369e-45b5-b25f-03b97f9e03ba,is_default=True,name='default',project_id='f09655506e354c9d991f4df9a92f4086',revision_number=1,rules=[SecurityGroupRule(3a81a654-abc8-4ca3-88f7-ee7eeeabdf72),SecurityGroupRule(9d7d0e90-575e-4117-99db-a401ac2050fa),SecurityGroupRule(ad4cc8fb-4c5c-4ac1-a06a-27398f514083),SecurityGroupRule(ae821adf-44a8-4b18-b325-b1e6e7fc5409)],shared=False,stateful=True,updated_at=2022-09-25T00:55:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:40.644457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3db039e0-13e5-4c13-b946-9e884984c67d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (a82a09b8-369e-45b5-b25f-03b97f9e03ba), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:40.646041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3db039e0-13e5-4c13-b946-9e884984c67d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:40Z,description=,direction='ingress',ethertype='IPv4',id=3a81a654-abc8-4ca3-88f7-ee7eeeabdf72,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f09655506e354c9d991f4df9a92f4086',protocol=,remote_address_group_id=,remote_group_id=a82a09b8-369e-45b5-b25f-03b97f9e03ba,remote_ip_prefix=,revision_number=0,security_group_id=a82a09b8-369e-45b5-b25f-03b97f9e03ba,updated_at=2022-09-25T00:55:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:40.646632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3db039e0-13e5-4c13-b946-9e884984c67d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (3a81a654-abc8-4ca3-88f7-ee7eeeabdf72), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:40.647249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-3db039e0-13e5-4c13-b946-9e884984c67d admin admin] Security group rule updated ['a82a09b8-369e-45b5-b25f-03b97f9e03ba'] Sep 25 00:55:40.648299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3db039e0-13e5-4c13-b946-9e884984c67d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:40Z,description=,direction='egress',ethertype='IPv4',id=9d7d0e90-575e-4117-99db-a401ac2050fa,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f09655506e354c9d991f4df9a92f4086',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a82a09b8-369e-45b5-b25f-03b97f9e03ba,updated_at=2022-09-25T00:55:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:40.648888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3db039e0-13e5-4c13-b946-9e884984c67d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (9d7d0e90-575e-4117-99db-a401ac2050fa), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:40.649963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-3db039e0-13e5-4c13-b946-9e884984c67d admin admin] Security group rule updated ['a82a09b8-369e-45b5-b25f-03b97f9e03ba'] Sep 25 00:55:40.653971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3db039e0-13e5-4c13-b946-9e884984c67d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:40Z,description=,direction='egress',ethertype='IPv6',id=ad4cc8fb-4c5c-4ac1-a06a-27398f514083,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f09655506e354c9d991f4df9a92f4086',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a82a09b8-369e-45b5-b25f-03b97f9e03ba,updated_at=2022-09-25T00:55:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:40.654616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3db039e0-13e5-4c13-b946-9e884984c67d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (ad4cc8fb-4c5c-4ac1-a06a-27398f514083), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:40.655172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-3db039e0-13e5-4c13-b946-9e884984c67d admin admin] Security group rule updated ['a82a09b8-369e-45b5-b25f-03b97f9e03ba'] Sep 25 00:55:40.656188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3db039e0-13e5-4c13-b946-9e884984c67d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:40Z,description=,direction='ingress',ethertype='IPv6',id=ae821adf-44a8-4b18-b325-b1e6e7fc5409,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f09655506e354c9d991f4df9a92f4086',protocol=,remote_address_group_id=,remote_group_id=a82a09b8-369e-45b5-b25f-03b97f9e03ba,remote_ip_prefix=,revision_number=0,security_group_id=a82a09b8-369e-45b5-b25f-03b97f9e03ba,updated_at=2022-09-25T00:55:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:40.656770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3db039e0-13e5-4c13-b946-9e884984c67d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (ae821adf-44a8-4b18-b325-b1e6e7fc5409), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:40.657311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-3db039e0-13e5-4c13-b946-9e884984c67d admin admin] Security group rule updated ['a82a09b8-369e-45b5-b25f-03b97f9e03ba'] Sep 25 00:55:40.661994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-389d679b-dc6f-4ff6-a759-b6931d23ec22 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(eee400e4-c715-4670-8c64-2547649139dd)],cidr=172.20.0.0/28,created_at=2022-09-25T00:55:40Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=0e647c01-1f0c-448e-8162-e47ee7cb9c90,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-AttachVolumeNegativeTest-521498035-subnet',network_id=5dc49b54-686c-4619-ad4c-65c72c26fd31,project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-25T00:55:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:40.662652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-389d679b-dc6f-4ff6-a759-b6931d23ec22 admin admin] Publish callbacks [] for Subnet (0e647c01-1f0c-448e-8162-e47ee7cb9c90), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:40.930392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3db039e0-13e5-4c13-b946-9e884984c67d admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-25T00:55:40Z,description='',dns_domain=None,id=334cdfa6-14bd-4f9b-b93c-dbd866cdb6bb,mtu=1500,name='tempest-AttachVolumeShelveTestJSON-2119362732-network',project_id='f09655506e354c9d991f4df9a92f4086',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(334cdfa6-14bd-4f9b-b93c-dbd866cdb6bb),segments=[NetworkSegment(60226fdd-ab84-4bff-9bed-5551adf26f89)],shared=False,status='ACTIVE',updated_at=2022-09-25T00:55:40Z,vlan_transparent=) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:40.932030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3db039e0-13e5-4c13-b946-9e884984c67d admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (334cdfa6-14bd-4f9b-b93c-dbd866cdb6bb), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:41.036229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-72cc6cdc-dae3-47ef-a581-029176132655 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:55:40Z,description='Default security group',id=33e8b406-0d9d-4791-be58-7ab180367bdc,is_default=True,name='default',project_id='5ca92ea462d24d2d8632e5c52a3dfe63',revision_number=1,rules=[SecurityGroupRule(053bc846-8c38-4371-84fd-22fd0dcc31fa),SecurityGroupRule(33ddf804-d1cd-4d45-9735-f06d45cb147f),SecurityGroupRule(57d88bec-a3ea-447c-af22-1213688c1312),SecurityGroupRule(b5935d81-53d0-41c4-a5cf-8e594029fdda)],shared=False,stateful=True,updated_at=2022-09-25T00:55:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:41.036869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-72cc6cdc-dae3-47ef-a581-029176132655 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (33e8b406-0d9d-4791-be58-7ab180367bdc), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:41.037726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-72cc6cdc-dae3-47ef-a581-029176132655 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:40Z,description=,direction='ingress',ethertype='IPv4',id=053bc846-8c38-4371-84fd-22fd0dcc31fa,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5ca92ea462d24d2d8632e5c52a3dfe63',protocol=,remote_address_group_id=,remote_group_id=33e8b406-0d9d-4791-be58-7ab180367bdc,remote_ip_prefix=,revision_number=0,security_group_id=33e8b406-0d9d-4791-be58-7ab180367bdc,updated_at=2022-09-25T00:55:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:41.038271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-72cc6cdc-dae3-47ef-a581-029176132655 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (053bc846-8c38-4371-84fd-22fd0dcc31fa), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:41.039058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-72cc6cdc-dae3-47ef-a581-029176132655 admin admin] Security group rule updated ['33e8b406-0d9d-4791-be58-7ab180367bdc'] Sep 25 00:55:41.041319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-72cc6cdc-dae3-47ef-a581-029176132655 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:40Z,description=,direction='egress',ethertype='IPv6',id=33ddf804-d1cd-4d45-9735-f06d45cb147f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5ca92ea462d24d2d8632e5c52a3dfe63',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=33e8b406-0d9d-4791-be58-7ab180367bdc,updated_at=2022-09-25T00:55:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:41.042036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-72cc6cdc-dae3-47ef-a581-029176132655 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (33ddf804-d1cd-4d45-9735-f06d45cb147f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:41.042555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-72cc6cdc-dae3-47ef-a581-029176132655 admin admin] Security group rule updated ['33e8b406-0d9d-4791-be58-7ab180367bdc'] Sep 25 00:55:41.060600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-72cc6cdc-dae3-47ef-a581-029176132655 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:40Z,description=,direction='ingress',ethertype='IPv6',id=57d88bec-a3ea-447c-af22-1213688c1312,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5ca92ea462d24d2d8632e5c52a3dfe63',protocol=,remote_address_group_id=,remote_group_id=33e8b406-0d9d-4791-be58-7ab180367bdc,remote_ip_prefix=,revision_number=0,security_group_id=33e8b406-0d9d-4791-be58-7ab180367bdc,updated_at=2022-09-25T00:55:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:41.062300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-72cc6cdc-dae3-47ef-a581-029176132655 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (57d88bec-a3ea-447c-af22-1213688c1312), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:41.062771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-72cc6cdc-dae3-47ef-a581-029176132655 admin admin] Security group rule updated ['33e8b406-0d9d-4791-be58-7ab180367bdc'] Sep 25 00:55:41.077964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-72cc6cdc-dae3-47ef-a581-029176132655 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:40Z,description=,direction='egress',ethertype='IPv4',id=b5935d81-53d0-41c4-a5cf-8e594029fdda,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5ca92ea462d24d2d8632e5c52a3dfe63',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=33e8b406-0d9d-4791-be58-7ab180367bdc,updated_at=2022-09-25T00:55:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:41.077964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-72cc6cdc-dae3-47ef-a581-029176132655 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (b5935d81-53d0-41c4-a5cf-8e594029fdda), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:41.077964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-72cc6cdc-dae3-47ef-a581-029176132655 admin admin] Security group rule updated ['33e8b406-0d9d-4791-be58-7ab180367bdc'] Sep 25 00:55:41.186508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-150f60f0-9f7f-40ee-9f24-54d995f4ebca admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:55:40Z,description='Default security group',id=228a413f-3378-42d6-84fd-cf375d775113,is_default=True,name='default',project_id='28568584195d475fbc52d76185e09044',revision_number=1,rules=[SecurityGroupRule(3342341f-6be0-416e-b642-9a6bf4adc461),SecurityGroupRule(b3d9cd87-47e6-4689-8fd4-b907f4d2fbac),SecurityGroupRule(b977ef05-178f-4f0d-bd01-aac2b8900b6c),SecurityGroupRule(c887f708-a92b-43c0-947b-3b8c97a13436)],shared=False,stateful=True,updated_at=2022-09-25T00:55:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:41.187285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-150f60f0-9f7f-40ee-9f24-54d995f4ebca admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (228a413f-3378-42d6-84fd-cf375d775113), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:41.188185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-150f60f0-9f7f-40ee-9f24-54d995f4ebca admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:40Z,description=,direction='egress',ethertype='IPv4',id=3342341f-6be0-416e-b642-9a6bf4adc461,normalized_cidr=None,port_range_max=,port_range_min=,project_id='28568584195d475fbc52d76185e09044',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=228a413f-3378-42d6-84fd-cf375d775113,updated_at=2022-09-25T00:55:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:41.188791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-150f60f0-9f7f-40ee-9f24-54d995f4ebca admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (3342341f-6be0-416e-b642-9a6bf4adc461), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:41.189365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-150f60f0-9f7f-40ee-9f24-54d995f4ebca admin admin] Security group rule updated ['228a413f-3378-42d6-84fd-cf375d775113'] Sep 25 00:55:41.190376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-150f60f0-9f7f-40ee-9f24-54d995f4ebca admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:40Z,description=,direction='egress',ethertype='IPv6',id=b3d9cd87-47e6-4689-8fd4-b907f4d2fbac,normalized_cidr=None,port_range_max=,port_range_min=,project_id='28568584195d475fbc52d76185e09044',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=228a413f-3378-42d6-84fd-cf375d775113,updated_at=2022-09-25T00:55:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:41.191080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-150f60f0-9f7f-40ee-9f24-54d995f4ebca admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (b3d9cd87-47e6-4689-8fd4-b907f4d2fbac), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:41.192093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-150f60f0-9f7f-40ee-9f24-54d995f4ebca admin admin] Security group rule updated ['228a413f-3378-42d6-84fd-cf375d775113'] Sep 25 00:55:41.193608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-150f60f0-9f7f-40ee-9f24-54d995f4ebca admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:40Z,description=,direction='ingress',ethertype='IPv4',id=b977ef05-178f-4f0d-bd01-aac2b8900b6c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='28568584195d475fbc52d76185e09044',protocol=,remote_address_group_id=,remote_group_id=228a413f-3378-42d6-84fd-cf375d775113,remote_ip_prefix=,revision_number=0,security_group_id=228a413f-3378-42d6-84fd-cf375d775113,updated_at=2022-09-25T00:55:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:41.194259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-150f60f0-9f7f-40ee-9f24-54d995f4ebca admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (b977ef05-178f-4f0d-bd01-aac2b8900b6c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:41.195388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-150f60f0-9f7f-40ee-9f24-54d995f4ebca admin admin] Security group rule updated ['228a413f-3378-42d6-84fd-cf375d775113'] Sep 25 00:55:41.197975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-150f60f0-9f7f-40ee-9f24-54d995f4ebca admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:40Z,description=,direction='ingress',ethertype='IPv6',id=c887f708-a92b-43c0-947b-3b8c97a13436,normalized_cidr=None,port_range_max=,port_range_min=,project_id='28568584195d475fbc52d76185e09044',protocol=,remote_address_group_id=,remote_group_id=228a413f-3378-42d6-84fd-cf375d775113,remote_ip_prefix=,revision_number=0,security_group_id=228a413f-3378-42d6-84fd-cf375d775113,updated_at=2022-09-25T00:55:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:41.199567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-150f60f0-9f7f-40ee-9f24-54d995f4ebca admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (c887f708-a92b-43c0-947b-3b8c97a13436), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:41.201655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-150f60f0-9f7f-40ee-9f24-54d995f4ebca admin admin] Security group rule updated ['228a413f-3378-42d6-84fd-cf375d775113'] Sep 25 00:55:41.247496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager [None req-3db039e0-13e5-4c13-b946-9e884984c67d admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 334cdfa6-14bd-4f9b-b93c-dbd866cdb6bb with segmentation id not found. Sep 25 00:55:41.247496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 25 00:55:41.247496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 25 00:55:41.247496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 25 00:55:41.247496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 25 00:55:41.247496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 25 00:55:41.247496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 25 00:55:41.247496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 25 00:55:41.247496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 25 00:55:41.247496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 25 00:55:41.247496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 25 00:55:41.247496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 25 00:55:41.247496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 25 00:55:41.248467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 25 00:55:41.248467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 25 00:55:41.248467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 25 00:55:41.248467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 334cdfa6-14bd-4f9b-b93c-dbd866cdb6bb with segmentation id not found. Sep 25 00:55:41.248467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Sep 25 00:55:41.679359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-72cc6cdc-dae3-47ef-a581-029176132655 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-25T00:55:40Z,description='',dns_domain=None,id=c3254d23-d48a-485d-a0e8-5f41e3baa079,mtu=1500,name='tempest-DeleteServersTestJSON-882938189-network',project_id='5ca92ea462d24d2d8632e5c52a3dfe63',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(c3254d23-d48a-485d-a0e8-5f41e3baa079),segments=[NetworkSegment(47b88da7-e2fb-4714-bbd5-a18aae097f49)],shared=False,status='ACTIVE',updated_at=2022-09-25T00:55:41Z,vlan_transparent=) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:41.680067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-72cc6cdc-dae3-47ef-a581-029176132655 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (c3254d23-d48a-485d-a0e8-5f41e3baa079), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:41.955565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager [None req-72cc6cdc-dae3-47ef-a581-029176132655 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network c3254d23-d48a-485d-a0e8-5f41e3baa079 with segmentation id not found. Sep 25 00:55:41.955565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 25 00:55:41.955565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 25 00:55:41.955565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 25 00:55:41.955565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 25 00:55:41.955565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 25 00:55:41.955565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 25 00:55:41.955565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 25 00:55:41.955565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 25 00:55:41.955565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 25 00:55:41.955565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 25 00:55:41.955565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 25 00:55:41.955565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 25 00:55:41.957103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 25 00:55:41.957103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 25 00:55:41.957103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 25 00:55:41.957103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network c3254d23-d48a-485d-a0e8-5f41e3baa079 with segmentation id not found. Sep 25 00:55:41.957103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Sep 25 00:55:42.228640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-150f60f0-9f7f-40ee-9f24-54d995f4ebca admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-25T00:55:40Z,description='',dns_domain=None,id=e04e78f2-fc42-4b3e-9ba5-62cef58448f8,mtu=1500,name='tempest-ServerRescueNegativeTestJSON-1628878656-network',project_id='28568584195d475fbc52d76185e09044',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(e04e78f2-fc42-4b3e-9ba5-62cef58448f8),segments=[NetworkSegment(6dee2139-73a3-4d84-b994-05c9c1e85f42)],shared=False,status='ACTIVE',updated_at=2022-09-25T00:55:41Z,vlan_transparent=) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:42.229182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-150f60f0-9f7f-40ee-9f24-54d995f4ebca admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (e04e78f2-fc42-4b3e-9ba5-62cef58448f8), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:42.242744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b40b7563-c894-405a-a1fc-e4bfe58a48dc None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:55:41Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-5dc49b54-686c-4619-ad4c-65c72c26fd31',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=5f7cf548-5cfd-4292-be0b-8779295d8830,mac_address=fa:16:3e:11:bb:d9,name='',network_id=5dc49b54-686c-4619-ad4c-65c72c26fd31,numa_affinity_policy=,project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(5f7cf548-5cfd-4292-be0b-8779295d8830),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:55:42Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:42.243334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b40b7563-c894-405a-a1fc-e4bfe58a48dc None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (5f7cf548-5cfd-4292-be0b-8779295d8830), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:42.261417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:249 started Sep 25 00:55:42.278794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de79,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=990000000,duration_sec=504,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:42.286149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:55:42.286945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:249 - starting polling. Elapsed:0.026 Sep 25 00:55:42.291211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:42.294617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:249 - port information retrieved. Elapsed:0.033 Sep 25 00:55:42.298336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:249 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.037 Sep 25 00:55:42.336269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager [None req-150f60f0-9f7f-40ee-9f24-54d995f4ebca admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network e04e78f2-fc42-4b3e-9ba5-62cef58448f8 with segmentation id not found. Sep 25 00:55:42.336269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 25 00:55:42.336269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 25 00:55:42.336269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 25 00:55:42.336269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 25 00:55:42.336269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 25 00:55:42.336269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 25 00:55:42.336269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 25 00:55:42.336269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 25 00:55:42.336269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 25 00:55:42.336269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 25 00:55:42.336269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 25 00:55:42.336269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 25 00:55:42.337344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 25 00:55:42.337344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 25 00:55:42.337344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 25 00:55:42.337344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network e04e78f2-fc42-4b3e-9ba5-62cef58448f8 with segmentation id not found. Sep 25 00:55:42.337344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Sep 25 00:55:42.342988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9a87bd50-a9e0-437a-8843-ba01dfc01838 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(1cf85e74-81e9-4bd9-8b2a-8d2e63ba18f9)],cidr=172.20.0.0/28,created_at=2022-09-25T00:55:41Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=cf3d0ae1-4d69-474f-b9d5-17c189ebf5ae,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-AttachVolumeShelveTestJSON-2119362732-subnet',network_id=334cdfa6-14bd-4f9b-b93c-dbd866cdb6bb,project_id='f09655506e354c9d991f4df9a92f4086',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-25T00:55:41Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:42.344020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9a87bd50-a9e0-437a-8843-ba01dfc01838 admin admin] Publish callbacks [] for Subnet (cf3d0ae1-4d69-474f-b9d5-17c189ebf5ae), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:42.663221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-25c0b0b0-2249-4dbd-a216-d4a086769c5a admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:55:42Z,data_plane_status=None,description='',device_id='73160037-7787-46b1-aa0d-c30aa092a69a',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=0fd59bde-e230-44a6-9879-6a2bbb95a5fb,mac_address=fa:16:3e:aa:4d:d4,name='',network_id=62195cd6-54fa-4e24-9d47-ae0de6356ac2,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(0fd59bde-e230-44a6-9879-6a2bbb95a5fb),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:55:42Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:42.663628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-25c0b0b0-2249-4dbd-a216-d4a086769c5a admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (0fd59bde-e230-44a6-9879-6a2bbb95a5fb), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:42.742155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5a41665f-e243-4bbb-8a3e-7d9b0327f5a6 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(c2d2afc4-fb8f-423f-9a97-9b28158a28cf)],cidr=172.20.0.0/28,created_at=2022-09-25T00:55:41Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=d4d50c9e-21e6-4b33-9f79-09c2d9887013,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-DeleteServersTestJSON-882938189-subnet',network_id=c3254d23-d48a-485d-a0e8-5f41e3baa079,project_id='5ca92ea462d24d2d8632e5c52a3dfe63',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-25T00:55:41Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:42.742606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5a41665f-e243-4bbb-8a3e-7d9b0327f5a6 admin admin] Publish callbacks [] for Subnet (d4d50c9e-21e6-4b33-9f79-09c2d9887013), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:43.436500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b40b7563-c894-405a-a1fc-e4bfe58a48dc None None] Resource Port 5f7cf548-5cfd-4292-be0b-8779295d8830 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=5f7cf548-5cfd-4292-be0b-8779295d8830,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=5f7cf548-5cfd-4292-be0b-8779295d8830,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=5f7cf548-5cfd-4292-be0b-8779295d8830,segment=NetworkSegment(32553459-8243-41b9-9fc0-bae9f5646e9f),segment_id=32553459-8243-41b9-9fc0-bae9f5646e9f)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:55:43.438008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b40b7563-c894-405a-a1fc-e4bfe58a48dc None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (5f7cf548-5cfd-4292-be0b-8779295d8830), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:43.566181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["484dc974-5585-4f15-9546-d03b46c49d97","insert","tap5f7cf548-5c",["set",[]],["map",[["attached-mac","fa:16:3e:11:bb:d9"],["iface-id","5f7cf548-5cfd-4292-be0b-8779295d8830"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:55:43.585363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["484dc974-5585-4f15-9546-d03b46c49d97","old",null,["set",[]],null],["","new","tap5f7cf548-5c",6,["map",[["attached-mac","fa:16:3e:11:bb:d9"],["iface-id","5f7cf548-5cfd-4292-be0b-8779295d8830"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:55:44.031231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4e28ff5d-7e5e-498f-9b94-aa54af509f51 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(2337dada-68b3-4613-a274-3de4a6ea6494)],cidr=172.20.0.0/28,created_at=2022-09-25T00:55:42Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=6474d219-e5a1-4a6c-8e41-4afa0ca3d765,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-ServerRescueNegativeTestJSON-1628878656-subnet',network_id=e04e78f2-fc42-4b3e-9ba5-62cef58448f8,project_id='28568584195d475fbc52d76185e09044',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-25T00:55:42Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:44.031711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4e28ff5d-7e5e-498f-9b94-aa54af509f51 admin admin] Publish callbacks [] for Subnet (6474d219-e5a1-4a6c-8e41-4afa0ca3d765), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:44.263821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:250 started Sep 25 00:55:44.266333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de7b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=992000000,duration_sec=506,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:44.267646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:55:44.268149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:250 - starting polling. Elapsed:0.005 Sep 25 00:55:44.269777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:44.271965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:250 - port information retrieved. Elapsed:0.008 Sep 25 00:55:44.272427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'fa672580-39eb-4bef-ac5b-6be835c6c88c', 'de4727a2-569d-44c6-a53e-ecc89817f610', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '5f7cf548-5cfd-4292-be0b-8779295d8830', '5204c0c3-4410-4695-a405-b599292c4e80'}, 'added': {'5f7cf548-5cfd-4292-be0b-8779295d8830'}, 'removed': set(), 'updated': {'5f7cf548-5cfd-4292-be0b-8779295d8830'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:55:44.273024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '5f7cf548-5cfd-4292-be0b-8779295d8830', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-5dc49b54-686c-4619-ad4c-65c72c26fd31', 'network_id': '5dc49b54-686c-4619-ad4c-65c72c26fd31', 'port_id': '5f7cf548-5cfd-4292-be0b-8779295d8830', 'mac_address': 'fa:16:3e:11:bb:d9', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 71, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '0e647c01-1f0c-448e-8162-e47ee7cb9c90', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:55:44.278280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 5f7cf548-5cfd-4292-be0b-8779295d8830 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:55:44.278827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 5f7cf548-5cfd-4292-be0b-8779295d8830 updated. Details: {'device': '5f7cf548-5cfd-4292-be0b-8779295d8830', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-5dc49b54-686c-4619-ad4c-65c72c26fd31', 'network_id': '5dc49b54-686c-4619-ad4c-65c72c26fd31', 'port_id': '5f7cf548-5cfd-4292-be0b-8779295d8830', 'mac_address': 'fa:16:3e:11:bb:d9', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 71, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '0e647c01-1f0c-448e-8162-e47ee7cb9c90', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 25 00:55:44.279394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Assigning 4 as local vlan for net-id=5dc49b54-686c-4619-ad4c-65c72c26fd31, seg-id=71 Sep 25 00:55:44.299374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xa5d7ab3c,OFPFlowMod(buffer_id=4294967295,command=0,cookie=13979250796582379444,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4167), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4100}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:44.327244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x7834de7d,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4100)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4167}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:44.328369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap5f7cf548-5c, col_values=(('tag', 4),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:44.328818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap5f7cf548-5c, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:44.329285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap5f7cf548-5c, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:44.355530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap5f7cf548-5c, col_values=(('other_config', {'net_uuid': '5dc49b54-686c-4619-ad4c-65c72c26fd31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '4', 'segmentation_id': '71'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:44.419860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834de7f,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 6}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:44.420214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:250 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 5 devices currently available. Time elapsed: 0.147 Sep 25 00:55:44.420578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing device filters for 1 new devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 25 00:55:44.420884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing filters for devices {'5f7cf548-5cfd-4292-be0b-8779295d8830'} Sep 25 00:55:44.422098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:55:44.422379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:55:44.427899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:55:44.530108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bdbbca-0688-4d84-9c57-110854f06da2]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:55:44.531452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:250 - agent port security group processed in 0.259 Sep 25 00:55:44.532223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 5f7cf548-5cfd-4292-be0b-8779295d8830 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:55:44.562299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-408caf07-5361-4b29-985f-573c75e664b9 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:55:43Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-c3254d23-d48a-485d-a0e8-5f41e3baa079',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=fc7bb1a7-9a53-42b3-8205-cc1649a623f2,mac_address=fa:16:3e:5a:0b:ce,name='',network_id=c3254d23-d48a-485d-a0e8-5f41e3baa079,numa_affinity_policy=,project_id='5ca92ea462d24d2d8632e5c52a3dfe63',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(fc7bb1a7-9a53-42b3-8205-cc1649a623f2),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:55:44Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:44.562698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-408caf07-5361-4b29-985f-573c75e664b9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (fc7bb1a7-9a53-42b3-8205-cc1649a623f2), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:44.835464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7805f2ef-cd3f-47d7-bea5-6bbedf550ca1 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:55:43Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-334cdfa6-14bd-4f9b-b93c-dbd866cdb6bb',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=8a22f42d-c327-4ae1-9e34-d8947d30272d,mac_address=fa:16:3e:73:a2:1a,name='',network_id=334cdfa6-14bd-4f9b-b93c-dbd866cdb6bb,numa_affinity_policy=,project_id='f09655506e354c9d991f4df9a92f4086',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(8a22f42d-c327-4ae1-9e34-d8947d30272d),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:55:44Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:44.835869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7805f2ef-cd3f-47d7-bea5-6bbedf550ca1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (8a22f42d-c327-4ae1-9e34-d8947d30272d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:45.463991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5c8de82e-cca8-42ce-8967-c94e4eada95d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:55:44Z,description='Default security group',id=61a8a399-410a-46ef-b7a9-ff48b0a458b4,is_default=True,name='default',project_id='8f6ac5d4eff54d17a8a5c5e39849f66a',revision_number=1,rules=[SecurityGroupRule(216810f1-3a4b-4f40-8df6-91d3f7b03e68),SecurityGroupRule(4c77d4ea-cb29-4c64-866f-4f972a293d6e),SecurityGroupRule(8f02d290-affa-4488-817c-3f50885d6071),SecurityGroupRule(f1b7b791-9ab8-47f3-b54e-da5eca08957e)],shared=False,stateful=True,updated_at=2022-09-25T00:55:44Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:45.464599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5c8de82e-cca8-42ce-8967-c94e4eada95d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (61a8a399-410a-46ef-b7a9-ff48b0a458b4), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:45.465404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5c8de82e-cca8-42ce-8967-c94e4eada95d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:44Z,description=,direction='egress',ethertype='IPv4',id=216810f1-3a4b-4f40-8df6-91d3f7b03e68,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8f6ac5d4eff54d17a8a5c5e39849f66a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=61a8a399-410a-46ef-b7a9-ff48b0a458b4,updated_at=2022-09-25T00:55:44Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:45.465955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5c8de82e-cca8-42ce-8967-c94e4eada95d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (216810f1-3a4b-4f40-8df6-91d3f7b03e68), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:45.466440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5c8de82e-cca8-42ce-8967-c94e4eada95d admin admin] Security group rule updated ['61a8a399-410a-46ef-b7a9-ff48b0a458b4'] Sep 25 00:55:45.467278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5c8de82e-cca8-42ce-8967-c94e4eada95d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:44Z,description=,direction='ingress',ethertype='IPv4',id=4c77d4ea-cb29-4c64-866f-4f972a293d6e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8f6ac5d4eff54d17a8a5c5e39849f66a',protocol=,remote_address_group_id=,remote_group_id=61a8a399-410a-46ef-b7a9-ff48b0a458b4,remote_ip_prefix=,revision_number=0,security_group_id=61a8a399-410a-46ef-b7a9-ff48b0a458b4,updated_at=2022-09-25T00:55:44Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:45.469441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5c8de82e-cca8-42ce-8967-c94e4eada95d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (4c77d4ea-cb29-4c64-866f-4f972a293d6e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:45.469945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5c8de82e-cca8-42ce-8967-c94e4eada95d admin admin] Security group rule updated ['61a8a399-410a-46ef-b7a9-ff48b0a458b4'] Sep 25 00:55:45.470790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5c8de82e-cca8-42ce-8967-c94e4eada95d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:44Z,description=,direction='egress',ethertype='IPv6',id=8f02d290-affa-4488-817c-3f50885d6071,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8f6ac5d4eff54d17a8a5c5e39849f66a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=61a8a399-410a-46ef-b7a9-ff48b0a458b4,updated_at=2022-09-25T00:55:44Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:45.471306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5c8de82e-cca8-42ce-8967-c94e4eada95d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (8f02d290-affa-4488-817c-3f50885d6071), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:45.471782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5c8de82e-cca8-42ce-8967-c94e4eada95d admin admin] Security group rule updated ['61a8a399-410a-46ef-b7a9-ff48b0a458b4'] Sep 25 00:55:45.476294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5c8de82e-cca8-42ce-8967-c94e4eada95d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:44Z,description=,direction='ingress',ethertype='IPv6',id=f1b7b791-9ab8-47f3-b54e-da5eca08957e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8f6ac5d4eff54d17a8a5c5e39849f66a',protocol=,remote_address_group_id=,remote_group_id=61a8a399-410a-46ef-b7a9-ff48b0a458b4,remote_ip_prefix=,revision_number=0,security_group_id=61a8a399-410a-46ef-b7a9-ff48b0a458b4,updated_at=2022-09-25T00:55:44Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:45.476828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5c8de82e-cca8-42ce-8967-c94e4eada95d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f1b7b791-9ab8-47f3-b54e-da5eca08957e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:45.477426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5c8de82e-cca8-42ce-8967-c94e4eada95d admin admin] Security group rule updated ['61a8a399-410a-46ef-b7a9-ff48b0a458b4'] Sep 25 00:55:45.615429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["66e34c04-e3da-4ff7-8d35-2c32dfca3226","insert","tapfc7bb1a7-9a",["set",[]],["map",[["attached-mac","fa:16:3e:5a:0b:ce"],["iface-id","fc7bb1a7-9a53-42b3-8205-cc1649a623f2"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:55:45.629296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["66e34c04-e3da-4ff7-8d35-2c32dfca3226","old",null,["set",[]],null],["","new","tapfc7bb1a7-9a",7,["map",[["attached-mac","fa:16:3e:5a:0b:ce"],["iface-id","fc7bb1a7-9a53-42b3-8205-cc1649a623f2"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:55:45.925165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9d27bd3c-cd6d-4bcd-9aaa-b24db7be6c6b admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:55:44Z,description='Default security group',id=2a661fd5-a0bc-4853-8d4d-e156089afde6,is_default=True,name='default',project_id='412b366eb919434fa673464d0688b498',revision_number=1,rules=[SecurityGroupRule(0e1470a0-a2d7-4174-961d-992890c738f3),SecurityGroupRule(31dfa223-eb83-4ea7-bd6e-bc591775b8bf),SecurityGroupRule(8d0570c1-b8fd-42ce-9a11-30160a2940bc),SecurityGroupRule(e55621a8-07aa-4efd-91e6-83c9d04e3d99)],shared=False,stateful=True,updated_at=2022-09-25T00:55:45Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:45.925744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9d27bd3c-cd6d-4bcd-9aaa-b24db7be6c6b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (2a661fd5-a0bc-4853-8d4d-e156089afde6), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:45.926527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9d27bd3c-cd6d-4bcd-9aaa-b24db7be6c6b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:45Z,description=,direction='ingress',ethertype='IPv6',id=0e1470a0-a2d7-4174-961d-992890c738f3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='412b366eb919434fa673464d0688b498',protocol=,remote_address_group_id=,remote_group_id=2a661fd5-a0bc-4853-8d4d-e156089afde6,remote_ip_prefix=,revision_number=0,security_group_id=2a661fd5-a0bc-4853-8d4d-e156089afde6,updated_at=2022-09-25T00:55:45Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:45.927047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9d27bd3c-cd6d-4bcd-9aaa-b24db7be6c6b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (0e1470a0-a2d7-4174-961d-992890c738f3), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:45.927552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9d27bd3c-cd6d-4bcd-9aaa-b24db7be6c6b admin admin] Security group rule updated ['2a661fd5-a0bc-4853-8d4d-e156089afde6'] Sep 25 00:55:45.928383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9d27bd3c-cd6d-4bcd-9aaa-b24db7be6c6b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:45Z,description=,direction='egress',ethertype='IPv4',id=31dfa223-eb83-4ea7-bd6e-bc591775b8bf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='412b366eb919434fa673464d0688b498',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2a661fd5-a0bc-4853-8d4d-e156089afde6,updated_at=2022-09-25T00:55:45Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:45.928894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9d27bd3c-cd6d-4bcd-9aaa-b24db7be6c6b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (31dfa223-eb83-4ea7-bd6e-bc591775b8bf), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:45.929425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9d27bd3c-cd6d-4bcd-9aaa-b24db7be6c6b admin admin] Security group rule updated ['2a661fd5-a0bc-4853-8d4d-e156089afde6'] Sep 25 00:55:45.930237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9d27bd3c-cd6d-4bcd-9aaa-b24db7be6c6b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:45Z,description=,direction='ingress',ethertype='IPv4',id=8d0570c1-b8fd-42ce-9a11-30160a2940bc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='412b366eb919434fa673464d0688b498',protocol=,remote_address_group_id=,remote_group_id=2a661fd5-a0bc-4853-8d4d-e156089afde6,remote_ip_prefix=,revision_number=0,security_group_id=2a661fd5-a0bc-4853-8d4d-e156089afde6,updated_at=2022-09-25T00:55:45Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:45.931315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9d27bd3c-cd6d-4bcd-9aaa-b24db7be6c6b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (8d0570c1-b8fd-42ce-9a11-30160a2940bc), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:45.932479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9d27bd3c-cd6d-4bcd-9aaa-b24db7be6c6b admin admin] Security group rule updated ['2a661fd5-a0bc-4853-8d4d-e156089afde6'] Sep 25 00:55:45.935622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9d27bd3c-cd6d-4bcd-9aaa-b24db7be6c6b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:45Z,description=,direction='egress',ethertype='IPv6',id=e55621a8-07aa-4efd-91e6-83c9d04e3d99,normalized_cidr=None,port_range_max=,port_range_min=,project_id='412b366eb919434fa673464d0688b498',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2a661fd5-a0bc-4853-8d4d-e156089afde6,updated_at=2022-09-25T00:55:45Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:45.936321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9d27bd3c-cd6d-4bcd-9aaa-b24db7be6c6b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (e55621a8-07aa-4efd-91e6-83c9d04e3d99), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:45.936804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9d27bd3c-cd6d-4bcd-9aaa-b24db7be6c6b admin admin] Security group rule updated ['2a661fd5-a0bc-4853-8d4d-e156089afde6'] Sep 25 00:55:45.951195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6a5456f2-ed16-4b6a-b81d-9e9eb484380f admin admin] Resource SecurityGroup deleted: 2a661fd5-a0bc-4853-8d4d-e156089afde6 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:55:45.951746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6a5456f2-ed16-4b6a-b81d-9e9eb484380f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (2a661fd5-a0bc-4853-8d4d-e156089afde6), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:45.952372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a5456f2-ed16-4b6a-b81d-9e9eb484380f admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2a661fd5-a0bc-4853-8d4d-e156089afde6',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:55:45.963877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d3b5c628-3820-4825-b4ad-1e60d6d7cd93 None None] Resource Port 0fd59bde-e230-44a6-9879-6a2bbb95a5fb updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=0fd59bde-e230-44a6-9879-6a2bbb95a5fb,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=0fd59bde-e230-44a6-9879-6a2bbb95a5fb,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:55:45.964621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d3b5c628-3820-4825-b4ad-1e60d6d7cd93 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (0fd59bde-e230-44a6-9879-6a2bbb95a5fb), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:46.117658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-408caf07-5361-4b29-985f-573c75e664b9 None None] Resource Port fc7bb1a7-9a53-42b3-8205-cc1649a623f2 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=fc7bb1a7-9a53-42b3-8205-cc1649a623f2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=fc7bb1a7-9a53-42b3-8205-cc1649a623f2,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=fc7bb1a7-9a53-42b3-8205-cc1649a623f2,segment=NetworkSegment(47b88da7-e2fb-4714-bbd5-a18aae097f49),segment_id=47b88da7-e2fb-4714-bbd5-a18aae097f49)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:55:46.119307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-408caf07-5361-4b29-985f-573c75e664b9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (fc7bb1a7-9a53-42b3-8205-cc1649a623f2), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:46.145528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6a5456f2-ed16-4b6a-b81d-9e9eb484380f admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2a661fd5-a0bc-4853-8d4d-e156089afde6',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:55:46.146347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6a5456f2-ed16-4b6a-b81d-9e9eb484380f admin admin] Resource SecurityGroupRule deleted: 0e1470a0-a2d7-4174-961d-992890c738f3 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:55:46.146933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6a5456f2-ed16-4b6a-b81d-9e9eb484380f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (0e1470a0-a2d7-4174-961d-992890c738f3), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:46.147813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-6a5456f2-ed16-4b6a-b81d-9e9eb484380f admin admin] Security group rule updated ['2a661fd5-a0bc-4853-8d4d-e156089afde6'] Sep 25 00:55:46.148464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6a5456f2-ed16-4b6a-b81d-9e9eb484380f admin admin] Resource SecurityGroupRule deleted: 31dfa223-eb83-4ea7-bd6e-bc591775b8bf {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:55:46.149123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6a5456f2-ed16-4b6a-b81d-9e9eb484380f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (31dfa223-eb83-4ea7-bd6e-bc591775b8bf), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:46.149963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-6a5456f2-ed16-4b6a-b81d-9e9eb484380f admin admin] Security group rule updated ['2a661fd5-a0bc-4853-8d4d-e156089afde6'] Sep 25 00:55:46.150568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6a5456f2-ed16-4b6a-b81d-9e9eb484380f admin admin] Resource SecurityGroupRule deleted: 8d0570c1-b8fd-42ce-9a11-30160a2940bc {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:55:46.151319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6a5456f2-ed16-4b6a-b81d-9e9eb484380f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (8d0570c1-b8fd-42ce-9a11-30160a2940bc), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:46.152469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-6a5456f2-ed16-4b6a-b81d-9e9eb484380f admin admin] Security group rule updated ['2a661fd5-a0bc-4853-8d4d-e156089afde6'] Sep 25 00:55:46.153069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6a5456f2-ed16-4b6a-b81d-9e9eb484380f admin admin] Resource SecurityGroupRule deleted: e55621a8-07aa-4efd-91e6-83c9d04e3d99 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:55:46.153656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6a5456f2-ed16-4b6a-b81d-9e9eb484380f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (e55621a8-07aa-4efd-91e6-83c9d04e3d99), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:46.154194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-6a5456f2-ed16-4b6a-b81d-9e9eb484380f admin admin] Security group rule updated ['2a661fd5-a0bc-4853-8d4d-e156089afde6'] Sep 25 00:55:46.395383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4f528b8d-bc2d-4e3d-a86c-00779a286e60 admin admin] Resource SecurityGroup deleted: 61a8a399-410a-46ef-b7a9-ff48b0a458b4 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:55:46.395767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4f528b8d-bc2d-4e3d-a86c-00779a286e60 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (61a8a399-410a-46ef-b7a9-ff48b0a458b4), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:46.397087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f528b8d-bc2d-4e3d-a86c-00779a286e60 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('61a8a399-410a-46ef-b7a9-ff48b0a458b4',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:55:46.515218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d3b5c628-3820-4825-b4ad-1e60d6d7cd93 None None] Resource Port 0fd59bde-e230-44a6-9879-6a2bbb95a5fb updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=0fd59bde-e230-44a6-9879-6a2bbb95a5fb,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=0fd59bde-e230-44a6-9879-6a2bbb95a5fb,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=0fd59bde-e230-44a6-9879-6a2bbb95a5fb,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:55:46.515606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d3b5c628-3820-4825-b4ad-1e60d6d7cd93 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (0fd59bde-e230-44a6-9879-6a2bbb95a5fb), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:46.550378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-eceb535c-72da-43af-be10-a971c11f7820 None None] Resource Port 5f7cf548-5cfd-4292-be0b-8779295d8830 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:55:46.551090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-eceb535c-72da-43af-be10-a971c11f7820 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (5f7cf548-5cfd-4292-be0b-8779295d8830), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:46.616782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4f528b8d-bc2d-4e3d-a86c-00779a286e60 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('61a8a399-410a-46ef-b7a9-ff48b0a458b4',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:55:46.617479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4f528b8d-bc2d-4e3d-a86c-00779a286e60 admin admin] Resource SecurityGroupRule deleted: 216810f1-3a4b-4f40-8df6-91d3f7b03e68 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:55:46.618328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4f528b8d-bc2d-4e3d-a86c-00779a286e60 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (216810f1-3a4b-4f40-8df6-91d3f7b03e68), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:46.618816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-4f528b8d-bc2d-4e3d-a86c-00779a286e60 admin admin] Security group rule updated ['61a8a399-410a-46ef-b7a9-ff48b0a458b4'] Sep 25 00:55:46.619391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4f528b8d-bc2d-4e3d-a86c-00779a286e60 admin admin] Resource SecurityGroupRule deleted: 4c77d4ea-cb29-4c64-866f-4f972a293d6e {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:55:46.620431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4f528b8d-bc2d-4e3d-a86c-00779a286e60 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (4c77d4ea-cb29-4c64-866f-4f972a293d6e), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:46.620890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-4f528b8d-bc2d-4e3d-a86c-00779a286e60 admin admin] Security group rule updated ['61a8a399-410a-46ef-b7a9-ff48b0a458b4'] Sep 25 00:55:46.621502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4f528b8d-bc2d-4e3d-a86c-00779a286e60 admin admin] Resource SecurityGroupRule deleted: 8f02d290-affa-4488-817c-3f50885d6071 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:55:46.622272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4f528b8d-bc2d-4e3d-a86c-00779a286e60 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (8f02d290-affa-4488-817c-3f50885d6071), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:46.622779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-4f528b8d-bc2d-4e3d-a86c-00779a286e60 admin admin] Security group rule updated ['61a8a399-410a-46ef-b7a9-ff48b0a458b4'] Sep 25 00:55:46.623395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4f528b8d-bc2d-4e3d-a86c-00779a286e60 admin admin] Resource SecurityGroupRule deleted: f1b7b791-9ab8-47f3-b54e-da5eca08957e {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:55:46.623860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4f528b8d-bc2d-4e3d-a86c-00779a286e60 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f1b7b791-9ab8-47f3-b54e-da5eca08957e), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:46.624431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-4f528b8d-bc2d-4e3d-a86c-00779a286e60 admin admin] Security group rule updated ['61a8a399-410a-46ef-b7a9-ff48b0a458b4'] Sep 25 00:55:46.850619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7805f2ef-cd3f-47d7-bea5-6bbedf550ca1 None None] Resource Port 8a22f42d-c327-4ae1-9e34-d8947d30272d updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=8a22f42d-c327-4ae1-9e34-d8947d30272d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=8a22f42d-c327-4ae1-9e34-d8947d30272d,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=8a22f42d-c327-4ae1-9e34-d8947d30272d,segment=NetworkSegment(60226fdd-ab84-4bff-9bed-5551adf26f89),segment_id=60226fdd-ab84-4bff-9bed-5551adf26f89)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:55:46.851202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7805f2ef-cd3f-47d7-bea5-6bbedf550ca1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (8a22f42d-c327-4ae1-9e34-d8947d30272d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:46.981128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["9d655808-30a5-4bf2-aaec-471749d82c7b","insert","tap8a22f42d-c3",["set",[]],["map",[["attached-mac","fa:16:3e:73:a2:1a"],["iface-id","8a22f42d-c327-4ae1-9e34-d8947d30272d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:55:47.005817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["9d655808-30a5-4bf2-aaec-471749d82c7b","old",null,["set",[]],null],["","new","tap8a22f42d-c3",8,["map",[["attached-mac","fa:16:3e:73:a2:1a"],["iface-id","8a22f42d-c327-4ae1-9e34-d8947d30272d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:55:47.277916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["9d854122-702d-42bb-8143-5ac095a8cfba","insert","qg-0fd59bde-e2",["set",[]],["map",[["attached-mac","fa:16:3e:aa:4d:d4"],["iface-id","0fd59bde-e230-44a6-9879-6a2bbb95a5fb"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:55:47.280946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['5f7cf548-5cfd-4292-be0b-8779295d8830'] and devices down [] completed. Sep 25 00:55:47.281556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:250 - ports processed. Elapsed:3.018 Sep 25 00:55:47.282111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:250 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:3.019 Sep 25 00:55:47.283055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Loop iteration exceeded interval (2 vs. 3.018583297729492)! {{(pid=107261) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Sep 25 00:55:47.284157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:251 started Sep 25 00:55:47.320306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["9d854122-702d-42bb-8143-5ac095a8cfba","old",null,["set",[]],null],["","new","qg-0fd59bde-e2",9,["map",[["attached-mac","fa:16:3e:aa:4d:d4"],["iface-id","0fd59bde-e230-44a6-9879-6a2bbb95a5fb"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:55:47.326596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de81,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=17000000,duration_sec=510,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:47.327980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:55:47.328959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:251 - starting polling. Elapsed:0.045 Sep 25 00:55:47.331988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:47.334268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:251 - port information retrieved. Elapsed:0.050 Sep 25 00:55:47.334832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'0fd59bde-e230-44a6-9879-6a2bbb95a5fb', 'fc7bb1a7-9a53-42b3-8205-cc1649a623f2', '8a22f42d-c327-4ae1-9e34-d8947d30272d', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', 'de4727a2-569d-44c6-a53e-ecc89817f610', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '5f7cf548-5cfd-4292-be0b-8779295d8830', '5204c0c3-4410-4695-a405-b599292c4e80'}, 'added': {'fc7bb1a7-9a53-42b3-8205-cc1649a623f2', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb'}, 'removed': set(), 'updated': {'5f7cf548-5cfd-4292-be0b-8779295d8830', 'fc7bb1a7-9a53-42b3-8205-cc1649a623f2', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:55:47.336298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '5f7cf548-5cfd-4292-be0b-8779295d8830', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-5dc49b54-686c-4619-ad4c-65c72c26fd31', 'network_id': '5dc49b54-686c-4619-ad4c-65c72c26fd31', 'port_id': '5f7cf548-5cfd-4292-be0b-8779295d8830', 'mac_address': 'fa:16:3e:11:bb:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 71, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '0e647c01-1f0c-448e-8162-e47ee7cb9c90', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:55:47.337275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': 'fc7bb1a7-9a53-42b3-8205-cc1649a623f2', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-c3254d23-d48a-485d-a0e8-5f41e3baa079', 'network_id': 'c3254d23-d48a-485d-a0e8-5f41e3baa079', 'port_id': 'fc7bb1a7-9a53-42b3-8205-cc1649a623f2', 'mac_address': 'fa:16:3e:5a:0b:ce', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 96, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd4d50c9e-21e6-4b33-9f79-09c2d9887013', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:55:47.337972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '8a22f42d-c327-4ae1-9e34-d8947d30272d', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-334cdfa6-14bd-4f9b-b93c-dbd866cdb6bb', 'network_id': '334cdfa6-14bd-4f9b-b93c-dbd866cdb6bb', 'port_id': '8a22f42d-c327-4ae1-9e34-d8947d30272d', 'mac_address': 'fa:16:3e:73:a2:1a', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 87, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'cf3d0ae1-4d69-474f-b9d5-17c189ebf5ae', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:55:47.338857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', 'device_id': '73160037-7787-46b1-aa0d-c30aa092a69a', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', 'mac_address': 'fa:16:3e:aa:4d:d4', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.28'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:55:47.341057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 5f7cf548-5cfd-4292-be0b-8779295d8830 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:55:47.341622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 5f7cf548-5cfd-4292-be0b-8779295d8830 updated. Details: {'device': '5f7cf548-5cfd-4292-be0b-8779295d8830', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-5dc49b54-686c-4619-ad4c-65c72c26fd31', 'network_id': '5dc49b54-686c-4619-ad4c-65c72c26fd31', 'port_id': '5f7cf548-5cfd-4292-be0b-8779295d8830', 'mac_address': 'fa:16:3e:11:bb:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 71, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '0e647c01-1f0c-448e-8162-e47ee7cb9c90', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 4} Sep 25 00:55:47.344478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap5f7cf548-5c, col_values=(('tag', 4),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:47.345113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap5f7cf548-5c, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:47.345726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap5f7cf548-5c, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:47.346354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:55:47.355056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a8f27b3d-cbf0-4429-a96e-6ace646354fa admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:55:45Z,data_plane_status=None,description='',device_id='73160037-7787-46b1-aa0d-c30aa092a69a',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=a62d43a0-f84e-4f0c-bde1-8e3aa339843e,mac_address=fa:16:3e:18:22:67,name='',network_id=5dc49b54-686c-4619-ad4c-65c72c26fd31,numa_affinity_policy=,project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(a62d43a0-f84e-4f0c-bde1-8e3aa339843e),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:55:46Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:47.355906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a8f27b3d-cbf0-4429-a96e-6ace646354fa admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (a62d43a0-f84e-4f0c-bde1-8e3aa339843e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:47.357648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap5f7cf548-5c, col_values=(('other_config', {'net_uuid': '5dc49b54-686c-4619-ad4c-65c72c26fd31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '71', 'tag': '4'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:47.359868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:55:47.366954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834de83,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 6}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:47.367521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: fc7bb1a7-9a53-42b3-8205-cc1649a623f2 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:55:47.368680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port fc7bb1a7-9a53-42b3-8205-cc1649a623f2 updated. Details: {'device': 'fc7bb1a7-9a53-42b3-8205-cc1649a623f2', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-c3254d23-d48a-485d-a0e8-5f41e3baa079', 'network_id': 'c3254d23-d48a-485d-a0e8-5f41e3baa079', 'port_id': 'fc7bb1a7-9a53-42b3-8205-cc1649a623f2', 'mac_address': 'fa:16:3e:5a:0b:ce', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 96, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd4d50c9e-21e6-4b33-9f79-09c2d9887013', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 25 00:55:47.369220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Assigning 5 as local vlan for net-id=c3254d23-d48a-485d-a0e8-5f41e3baa079, seg-id=96 Sep 25 00:55:47.373875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xa5d7ab3e,OFPFlowMod(buffer_id=4294967295,command=0,cookie=13979250796582379444,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4192), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4101}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:47.377520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x7834de85,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4101)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4192}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:47.379361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapfc7bb1a7-9a, col_values=(('tag', 5),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:47.380294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapfc7bb1a7-9a, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:47.380883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapfc7bb1a7-9a, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:47.391367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapfc7bb1a7-9a, col_values=(('other_config', {'net_uuid': 'c3254d23-d48a-485d-a0e8-5f41e3baa079', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '5', 'segmentation_id': '96'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:47.406028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834de87,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 7}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:47.406605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 8a22f42d-c327-4ae1-9e34-d8947d30272d {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:55:47.407053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 8a22f42d-c327-4ae1-9e34-d8947d30272d updated. Details: {'device': '8a22f42d-c327-4ae1-9e34-d8947d30272d', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-334cdfa6-14bd-4f9b-b93c-dbd866cdb6bb', 'network_id': '334cdfa6-14bd-4f9b-b93c-dbd866cdb6bb', 'port_id': '8a22f42d-c327-4ae1-9e34-d8947d30272d', 'mac_address': 'fa:16:3e:73:a2:1a', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 87, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'cf3d0ae1-4d69-474f-b9d5-17c189ebf5ae', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 25 00:55:47.407496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Assigning 6 as local vlan for net-id=334cdfa6-14bd-4f9b-b93c-dbd866cdb6bb, seg-id=87 Sep 25 00:55:47.419022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xa5d7ab40,OFPFlowMod(buffer_id=4294967295,command=0,cookie=13979250796582379444,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4183), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4102}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:47.424761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x7834de89,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4102)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4183}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:47.426297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap8a22f42d-c3, col_values=(('tag', 6),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:47.427500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap8a22f42d-c3, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:47.428097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap8a22f42d-c3, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:47.449980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap8a22f42d-c3, col_values=(('other_config', {'net_uuid': '334cdfa6-14bd-4f9b-b93c-dbd866cdb6bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '6', 'segmentation_id': '87'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:47.501994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834de8b,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 8}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:47.502556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 0fd59bde-e230-44a6-9879-6a2bbb95a5fb {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:55:47.503031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 0fd59bde-e230-44a6-9879-6a2bbb95a5fb updated. Details: {'device': '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', 'device_id': '73160037-7787-46b1-aa0d-c30aa092a69a', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', 'mac_address': 'fa:16:3e:aa:4d:d4', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.28'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 25 00:55:47.517371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-0fd59bde-e2, col_values=(('tag', 2),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:47.518245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-0fd59bde-e2, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:47.520129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-0fd59bde-e2, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:47.545686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-59743d0d-661e-498d-aab8-560b2b93ac52 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:55:45Z,data_plane_status=None,description='',device_id='65efe4c7-23fe-404a-935b-071fd874df87',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=eb9862a9-2d1e-4843-945a-d227bfbd9cd7,mac_address=fa:16:3e:49:5f:60,name='',network_id=62195cd6-54fa-4e24-9d47-ae0de6356ac2,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(eb9862a9-2d1e-4843-945a-d227bfbd9cd7),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:55:46Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:47.546460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-59743d0d-661e-498d-aab8-560b2b93ac52 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (eb9862a9-2d1e-4843-945a-d227bfbd9cd7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:47.548441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-0fd59bde-e2, col_values=(('other_config', {'net_uuid': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:47.576539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834de8d,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 9}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:47.576898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:251 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 8 devices currently available. Time elapsed: 0.242 Sep 25 00:55:47.577328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing device filters for 3 new devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 25 00:55:47.577842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing filters for devices {'fc7bb1a7-9a53-42b3-8205-cc1649a623f2', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb'} Sep 25 00:55:47.595230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:55:47.595737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:55:47.603518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 6 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:55:47.727519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc227e9-575c-44ea-937e-5edcb5f7abd0]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:55:47.728077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refreshing firewall for 1 devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 25 00:55:47.729078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refresh firewall rules Sep 25 00:55:47.730444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:55:47.730950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:55:47.734081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:55:47.838882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a1fa8d58-ca60-4bd6-9a45-e8ede278040e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:55:47Z,description='Default security group',id=5ef61b0f-f6f6-4f96-9d24-b94ee7c1bbfe,is_default=True,name='default',project_id='cc00f38ca5bb4d34806d54bc8967f23c',revision_number=1,rules=[SecurityGroupRule(6bc9f82d-c5a1-4260-8e85-577196d4c3bc),SecurityGroupRule(780a348f-d36d-4c26-8934-1ccf748f1d7c),SecurityGroupRule(c1e71069-0cf1-4220-a126-7f938e2193a6),SecurityGroupRule(f7ddb9dc-310c-4832-a80e-b460dbde8e45)],shared=False,stateful=True,updated_at=2022-09-25T00:55:47Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:47.839491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a1fa8d58-ca60-4bd6-9a45-e8ede278040e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (5ef61b0f-f6f6-4f96-9d24-b94ee7c1bbfe), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:47.840283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a1fa8d58-ca60-4bd6-9a45-e8ede278040e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:47Z,description=,direction='egress',ethertype='IPv4',id=6bc9f82d-c5a1-4260-8e85-577196d4c3bc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cc00f38ca5bb4d34806d54bc8967f23c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5ef61b0f-f6f6-4f96-9d24-b94ee7c1bbfe,updated_at=2022-09-25T00:55:47Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:47.840797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a1fa8d58-ca60-4bd6-9a45-e8ede278040e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (6bc9f82d-c5a1-4260-8e85-577196d4c3bc), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:47.841291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a1fa8d58-ca60-4bd6-9a45-e8ede278040e admin admin] Security group rule updated ['5ef61b0f-f6f6-4f96-9d24-b94ee7c1bbfe'] Sep 25 00:55:47.884179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[82551659-51a0-4184-8542-663ec344f2a6]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:55:47.884997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:251 - agent port security group processed in 0.550 Sep 25 00:55:47.885989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 5f7cf548-5cfd-4292-be0b-8779295d8830 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:55:47.886418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for fc7bb1a7-9a53-42b3-8205-cc1649a623f2 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:55:47.886828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 8a22f42d-c327-4ae1-9e34-d8947d30272d to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:55:47.887251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 0fd59bde-e230-44a6-9879-6a2bbb95a5fb to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:55:47.889464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a1fa8d58-ca60-4bd6-9a45-e8ede278040e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:47Z,description=,direction='ingress',ethertype='IPv6',id=780a348f-d36d-4c26-8934-1ccf748f1d7c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cc00f38ca5bb4d34806d54bc8967f23c',protocol=,remote_address_group_id=,remote_group_id=5ef61b0f-f6f6-4f96-9d24-b94ee7c1bbfe,remote_ip_prefix=,revision_number=0,security_group_id=5ef61b0f-f6f6-4f96-9d24-b94ee7c1bbfe,updated_at=2022-09-25T00:55:47Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:47.890019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a1fa8d58-ca60-4bd6-9a45-e8ede278040e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (780a348f-d36d-4c26-8934-1ccf748f1d7c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:47.890654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a1fa8d58-ca60-4bd6-9a45-e8ede278040e admin admin] Security group rule updated ['5ef61b0f-f6f6-4f96-9d24-b94ee7c1bbfe'] Sep 25 00:55:47.891776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a1fa8d58-ca60-4bd6-9a45-e8ede278040e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:47Z,description=,direction='egress',ethertype='IPv6',id=c1e71069-0cf1-4220-a126-7f938e2193a6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cc00f38ca5bb4d34806d54bc8967f23c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5ef61b0f-f6f6-4f96-9d24-b94ee7c1bbfe,updated_at=2022-09-25T00:55:47Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:47.892425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a1fa8d58-ca60-4bd6-9a45-e8ede278040e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (c1e71069-0cf1-4220-a126-7f938e2193a6), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:47.892896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a1fa8d58-ca60-4bd6-9a45-e8ede278040e admin admin] Security group rule updated ['5ef61b0f-f6f6-4f96-9d24-b94ee7c1bbfe'] Sep 25 00:55:47.893929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a1fa8d58-ca60-4bd6-9a45-e8ede278040e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:47Z,description=,direction='ingress',ethertype='IPv4',id=f7ddb9dc-310c-4832-a80e-b460dbde8e45,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cc00f38ca5bb4d34806d54bc8967f23c',protocol=,remote_address_group_id=,remote_group_id=5ef61b0f-f6f6-4f96-9d24-b94ee7c1bbfe,remote_ip_prefix=,revision_number=0,security_group_id=5ef61b0f-f6f6-4f96-9d24-b94ee7c1bbfe,updated_at=2022-09-25T00:55:47Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:47.894295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a1fa8d58-ca60-4bd6-9a45-e8ede278040e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f7ddb9dc-310c-4832-a80e-b460dbde8e45), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:47.894632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a1fa8d58-ca60-4bd6-9a45-e8ede278040e admin admin] Security group rule updated ['5ef61b0f-f6f6-4f96-9d24-b94ee7c1bbfe'] Sep 25 00:55:48.069497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c3ee5645-e63e-4e3c-8453-ea6f5e56fb14 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:55:45Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-e04e78f2-fc42-4b3e-9ba5-62cef58448f8',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=68a3f405-e599-4339-b2a8-058311132e20,mac_address=fa:16:3e:34:39:6a,name='',network_id=e04e78f2-fc42-4b3e-9ba5-62cef58448f8,numa_affinity_policy=,project_id='28568584195d475fbc52d76185e09044',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(68a3f405-e599-4339-b2a8-058311132e20),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:55:47Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:48.069896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c3ee5645-e63e-4e3c-8453-ea6f5e56fb14 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (68a3f405-e599-4339-b2a8-058311132e20), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:48.395720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0f5fbac5-d0ec-4c92-9254-42c31cf652aa admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:55:47Z,description='Default security group',id=0ef3794d-6c1e-45d3-8e5d-74b78dc45e5f,is_default=True,name='default',project_id='966cbe725c7a45dda78e7ac72e56a7b1',revision_number=1,rules=[SecurityGroupRule(106a1306-d0c9-4597-861d-0d8ca5657630),SecurityGroupRule(1edab286-d2f0-4832-acf2-9e6258694026),SecurityGroupRule(3835d74a-000c-4773-8b90-8c4d1df9e3d2),SecurityGroupRule(6efe96bf-aef2-41b3-b384-cb90c5108956)],shared=False,stateful=True,updated_at=2022-09-25T00:55:47Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:48.400466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0f5fbac5-d0ec-4c92-9254-42c31cf652aa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (0ef3794d-6c1e-45d3-8e5d-74b78dc45e5f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:48.403401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0f5fbac5-d0ec-4c92-9254-42c31cf652aa admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:47Z,description=,direction='egress',ethertype='IPv6',id=106a1306-d0c9-4597-861d-0d8ca5657630,normalized_cidr=None,port_range_max=,port_range_min=,project_id='966cbe725c7a45dda78e7ac72e56a7b1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0ef3794d-6c1e-45d3-8e5d-74b78dc45e5f,updated_at=2022-09-25T00:55:47Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:48.404038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0f5fbac5-d0ec-4c92-9254-42c31cf652aa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (106a1306-d0c9-4597-861d-0d8ca5657630), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:48.405584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-0f5fbac5-d0ec-4c92-9254-42c31cf652aa admin admin] Security group rule updated ['0ef3794d-6c1e-45d3-8e5d-74b78dc45e5f'] Sep 25 00:55:48.407792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0f5fbac5-d0ec-4c92-9254-42c31cf652aa admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:47Z,description=,direction='egress',ethertype='IPv4',id=1edab286-d2f0-4832-acf2-9e6258694026,normalized_cidr=None,port_range_max=,port_range_min=,project_id='966cbe725c7a45dda78e7ac72e56a7b1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0ef3794d-6c1e-45d3-8e5d-74b78dc45e5f,updated_at=2022-09-25T00:55:47Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:48.409328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0f5fbac5-d0ec-4c92-9254-42c31cf652aa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (1edab286-d2f0-4832-acf2-9e6258694026), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:48.410986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-0f5fbac5-d0ec-4c92-9254-42c31cf652aa admin admin] Security group rule updated ['0ef3794d-6c1e-45d3-8e5d-74b78dc45e5f'] Sep 25 00:55:48.412326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0f5fbac5-d0ec-4c92-9254-42c31cf652aa admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:47Z,description=,direction='ingress',ethertype='IPv6',id=3835d74a-000c-4773-8b90-8c4d1df9e3d2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='966cbe725c7a45dda78e7ac72e56a7b1',protocol=,remote_address_group_id=,remote_group_id=0ef3794d-6c1e-45d3-8e5d-74b78dc45e5f,remote_ip_prefix=,revision_number=0,security_group_id=0ef3794d-6c1e-45d3-8e5d-74b78dc45e5f,updated_at=2022-09-25T00:55:47Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:48.412944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0f5fbac5-d0ec-4c92-9254-42c31cf652aa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (3835d74a-000c-4773-8b90-8c4d1df9e3d2), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:48.413763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-0f5fbac5-d0ec-4c92-9254-42c31cf652aa admin admin] Security group rule updated ['0ef3794d-6c1e-45d3-8e5d-74b78dc45e5f'] Sep 25 00:55:48.414748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0f5fbac5-d0ec-4c92-9254-42c31cf652aa admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:47Z,description=,direction='ingress',ethertype='IPv4',id=6efe96bf-aef2-41b3-b384-cb90c5108956,normalized_cidr=None,port_range_max=,port_range_min=,project_id='966cbe725c7a45dda78e7ac72e56a7b1',protocol=,remote_address_group_id=,remote_group_id=0ef3794d-6c1e-45d3-8e5d-74b78dc45e5f,remote_ip_prefix=,revision_number=0,security_group_id=0ef3794d-6c1e-45d3-8e5d-74b78dc45e5f,updated_at=2022-09-25T00:55:47Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:48.416159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0f5fbac5-d0ec-4c92-9254-42c31cf652aa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (6efe96bf-aef2-41b3-b384-cb90c5108956), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:48.418414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-0f5fbac5-d0ec-4c92-9254-42c31cf652aa admin admin] Security group rule updated ['0ef3794d-6c1e-45d3-8e5d-74b78dc45e5f'] Sep 25 00:55:48.538606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-34b754fe-4a86-4e68-91a4-c28094800ba8 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:55:46Z,data_plane_status=None,description='',device_id='1756485f-d872-4799-a254-ef11e7f98682',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=b6b39056-a691-4ac9-a565-574d1c5a0cd5,mac_address=fa:16:3e:30:b6:c0,name='',network_id=62195cd6-54fa-4e24-9d47-ae0de6356ac2,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(b6b39056-a691-4ac9-a565-574d1c5a0cd5),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:55:46Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:48.540596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-34b754fe-4a86-4e68-91a4-c28094800ba8 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (b6b39056-a691-4ac9-a565-574d1c5a0cd5), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:48.709188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c3ee5645-e63e-4e3c-8453-ea6f5e56fb14 None None] Resource Port 68a3f405-e599-4339-b2a8-058311132e20 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=68a3f405-e599-4339-b2a8-058311132e20,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=68a3f405-e599-4339-b2a8-058311132e20,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=68a3f405-e599-4339-b2a8-058311132e20,segment=NetworkSegment(6dee2139-73a3-4d84-b994-05c9c1e85f42),segment_id=6dee2139-73a3-4d84-b994-05c9c1e85f42)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:55:48.709920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c3ee5645-e63e-4e3c-8453-ea6f5e56fb14 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (68a3f405-e599-4339-b2a8-058311132e20), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:48.907610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["1e370af9-1b91-4b6e-8ff4-f140cea017df","insert","tap68a3f405-e5",["set",[]],["map",[["attached-mac","fa:16:3e:34:39:6a"],["iface-id","68a3f405-e599-4339-b2a8-058311132e20"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:55:48.923276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["1e370af9-1b91-4b6e-8ff4-f140cea017df","old",null,["set",[]],null],["","new","tap68a3f405-e5",10,["map",[["attached-mac","fa:16:3e:34:39:6a"],["iface-id","68a3f405-e599-4339-b2a8-058311132e20"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:55:49.079600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5d0da7f7-ee42-40da-9924-74cda1254570 None None] Resource Port fc7bb1a7-9a53-42b3-8205-cc1649a623f2 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:55:49.079992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5d0da7f7-ee42-40da-9924-74cda1254570 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (fc7bb1a7-9a53-42b3-8205-cc1649a623f2), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:49.476080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9d23fdfb-ec10-4e3d-bf1b-1666213e9165 admin admin] Resource SecurityGroup deleted: 0ef3794d-6c1e-45d3-8e5d-74b78dc45e5f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:55:49.476605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9d23fdfb-ec10-4e3d-bf1b-1666213e9165 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (0ef3794d-6c1e-45d3-8e5d-74b78dc45e5f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:49.479613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d23fdfb-ec10-4e3d-bf1b-1666213e9165 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0ef3794d-6c1e-45d3-8e5d-74b78dc45e5f',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:55:49.620512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4206988b-b5a1-4b85-ae33-9056d101dbbb admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:55:47Z,data_plane_status=None,description='',device_id='0366ab62-209a-4a0a-a198-da6587ec3f4a',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=7d521366-e68f-48bd-a7a8-e2283117a2b7,mac_address=fa:16:3e:10:d9:d3,name='',network_id=62195cd6-54fa-4e24-9d47-ae0de6356ac2,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(7d521366-e68f-48bd-a7a8-e2283117a2b7),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:55:48Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:49.621080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4206988b-b5a1-4b85-ae33-9056d101dbbb admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (7d521366-e68f-48bd-a7a8-e2283117a2b7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:49.822868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9d23fdfb-ec10-4e3d-bf1b-1666213e9165 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0ef3794d-6c1e-45d3-8e5d-74b78dc45e5f',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:55:49.823513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9d23fdfb-ec10-4e3d-bf1b-1666213e9165 admin admin] Resource SecurityGroupRule deleted: 106a1306-d0c9-4597-861d-0d8ca5657630 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:55:49.824025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9d23fdfb-ec10-4e3d-bf1b-1666213e9165 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (106a1306-d0c9-4597-861d-0d8ca5657630), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:49.824724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9d23fdfb-ec10-4e3d-bf1b-1666213e9165 admin admin] Security group rule updated ['0ef3794d-6c1e-45d3-8e5d-74b78dc45e5f'] Sep 25 00:55:49.825228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9d23fdfb-ec10-4e3d-bf1b-1666213e9165 admin admin] Resource SecurityGroupRule deleted: 1edab286-d2f0-4832-acf2-9e6258694026 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:55:49.825796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9d23fdfb-ec10-4e3d-bf1b-1666213e9165 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (1edab286-d2f0-4832-acf2-9e6258694026), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:49.826921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9d23fdfb-ec10-4e3d-bf1b-1666213e9165 admin admin] Security group rule updated ['0ef3794d-6c1e-45d3-8e5d-74b78dc45e5f'] Sep 25 00:55:49.827416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9d23fdfb-ec10-4e3d-bf1b-1666213e9165 admin admin] Resource SecurityGroupRule deleted: 3835d74a-000c-4773-8b90-8c4d1df9e3d2 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:55:49.827948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9d23fdfb-ec10-4e3d-bf1b-1666213e9165 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (3835d74a-000c-4773-8b90-8c4d1df9e3d2), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:49.828344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9d23fdfb-ec10-4e3d-bf1b-1666213e9165 admin admin] Security group rule updated ['0ef3794d-6c1e-45d3-8e5d-74b78dc45e5f'] Sep 25 00:55:49.828975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9d23fdfb-ec10-4e3d-bf1b-1666213e9165 admin admin] Resource SecurityGroupRule deleted: 6efe96bf-aef2-41b3-b384-cb90c5108956 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:55:49.829507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9d23fdfb-ec10-4e3d-bf1b-1666213e9165 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (6efe96bf-aef2-41b3-b384-cb90c5108956), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:49.829892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9d23fdfb-ec10-4e3d-bf1b-1666213e9165 admin admin] Security group rule updated ['0ef3794d-6c1e-45d3-8e5d-74b78dc45e5f'] Sep 25 00:55:49.902180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4eb5f351-bce8-4c5c-94b1-226d094aecda admin admin] Resource SecurityGroup deleted: 5ef61b0f-f6f6-4f96-9d24-b94ee7c1bbfe {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:55:49.903570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4eb5f351-bce8-4c5c-94b1-226d094aecda admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (5ef61b0f-f6f6-4f96-9d24-b94ee7c1bbfe), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:49.904367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4eb5f351-bce8-4c5c-94b1-226d094aecda admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('5ef61b0f-f6f6-4f96-9d24-b94ee7c1bbfe',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:55:49.936135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a8f27b3d-cbf0-4429-a96e-6ace646354fa admin admin] Received resource Port update without any changes: a62d43a0-f84e-4f0c-bde1-8e3aa339843e {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 25 00:55:50.070388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4eb5f351-bce8-4c5c-94b1-226d094aecda admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('5ef61b0f-f6f6-4f96-9d24-b94ee7c1bbfe',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:55:50.071623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4eb5f351-bce8-4c5c-94b1-226d094aecda admin admin] Resource SecurityGroupRule deleted: 6bc9f82d-c5a1-4260-8e85-577196d4c3bc {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:55:50.072343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4eb5f351-bce8-4c5c-94b1-226d094aecda admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (6bc9f82d-c5a1-4260-8e85-577196d4c3bc), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:50.073515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-4eb5f351-bce8-4c5c-94b1-226d094aecda admin admin] Security group rule updated ['5ef61b0f-f6f6-4f96-9d24-b94ee7c1bbfe'] Sep 25 00:55:50.074127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4eb5f351-bce8-4c5c-94b1-226d094aecda admin admin] Resource SecurityGroupRule deleted: 780a348f-d36d-4c26-8934-1ccf748f1d7c {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:55:50.074678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4eb5f351-bce8-4c5c-94b1-226d094aecda admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (780a348f-d36d-4c26-8934-1ccf748f1d7c), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:50.075592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-4eb5f351-bce8-4c5c-94b1-226d094aecda admin admin] Security group rule updated ['5ef61b0f-f6f6-4f96-9d24-b94ee7c1bbfe'] Sep 25 00:55:50.076313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4eb5f351-bce8-4c5c-94b1-226d094aecda admin admin] Resource SecurityGroupRule deleted: c1e71069-0cf1-4220-a126-7f938e2193a6 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:55:50.076899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4eb5f351-bce8-4c5c-94b1-226d094aecda admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (c1e71069-0cf1-4220-a126-7f938e2193a6), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:50.077459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-4eb5f351-bce8-4c5c-94b1-226d094aecda admin admin] Security group rule updated ['5ef61b0f-f6f6-4f96-9d24-b94ee7c1bbfe'] Sep 25 00:55:50.078049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4eb5f351-bce8-4c5c-94b1-226d094aecda admin admin] Resource SecurityGroupRule deleted: f7ddb9dc-310c-4832-a80e-b460dbde8e45 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:55:50.078601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4eb5f351-bce8-4c5c-94b1-226d094aecda admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f7ddb9dc-310c-4832-a80e-b460dbde8e45), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:50.079119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-4eb5f351-bce8-4c5c-94b1-226d094aecda admin admin] Security group rule updated ['5ef61b0f-f6f6-4f96-9d24-b94ee7c1bbfe'] Sep 25 00:55:50.259673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-08e97a02-2214-4533-8396-7b0693037865 None None] Resource Port 8a22f42d-c327-4ae1-9e34-d8947d30272d updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:55:50.260769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-08e97a02-2214-4533-8396-7b0693037865 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (8a22f42d-c327-4ae1-9e34-d8947d30272d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:51.141125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['5f7cf548-5cfd-4292-be0b-8779295d8830', 'fc7bb1a7-9a53-42b3-8205-cc1649a623f2', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb'] and devices down [] completed. Sep 25 00:55:51.142613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:251 - ports processed. Elapsed:3.858 Sep 25 00:55:51.143095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:251 completed. Processed ports statistics: {'regular': {'added': 3, 'updated': 4, 'removed': 0}}. Elapsed:3.859 Sep 25 00:55:51.144012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Loop iteration exceeded interval (2 vs. 3.8589465618133545)! {{(pid=107261) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Sep 25 00:55:51.144495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:252 started Sep 25 00:55:51.148452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de8f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=873000000,duration_sec=513,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:51.149950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:55:51.150830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:252 - starting polling. Elapsed:0.006 Sep 25 00:55:51.153567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:51.160843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:252 - port information retrieved. Elapsed:0.016 Sep 25 00:55:51.162740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'8a22f42d-c327-4ae1-9e34-d8947d30272d', '68a3f405-e599-4339-b2a8-058311132e20', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', 'fc7bb1a7-9a53-42b3-8205-cc1649a623f2', 'de4727a2-569d-44c6-a53e-ecc89817f610', '5204c0c3-4410-4695-a405-b599292c4e80'}, 'added': {'68a3f405-e599-4339-b2a8-058311132e20'}, 'removed': set(), 'updated': {'fc7bb1a7-9a53-42b3-8205-cc1649a623f2', '68a3f405-e599-4339-b2a8-058311132e20', '8a22f42d-c327-4ae1-9e34-d8947d30272d'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:55:51.164138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': 'fc7bb1a7-9a53-42b3-8205-cc1649a623f2', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-c3254d23-d48a-485d-a0e8-5f41e3baa079', 'network_id': 'c3254d23-d48a-485d-a0e8-5f41e3baa079', 'port_id': 'fc7bb1a7-9a53-42b3-8205-cc1649a623f2', 'mac_address': 'fa:16:3e:5a:0b:ce', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 96, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd4d50c9e-21e6-4b33-9f79-09c2d9887013', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:55:51.165217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '68a3f405-e599-4339-b2a8-058311132e20', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-e04e78f2-fc42-4b3e-9ba5-62cef58448f8', 'network_id': 'e04e78f2-fc42-4b3e-9ba5-62cef58448f8', 'port_id': '68a3f405-e599-4339-b2a8-058311132e20', 'mac_address': 'fa:16:3e:34:39:6a', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 54, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6474d219-e5a1-4a6c-8e41-4afa0ca3d765', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:55:51.167881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '8a22f42d-c327-4ae1-9e34-d8947d30272d', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-334cdfa6-14bd-4f9b-b93c-dbd866cdb6bb', 'network_id': '334cdfa6-14bd-4f9b-b93c-dbd866cdb6bb', 'port_id': '8a22f42d-c327-4ae1-9e34-d8947d30272d', 'mac_address': 'fa:16:3e:73:a2:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 87, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'cf3d0ae1-4d69-474f-b9d5-17c189ebf5ae', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:55:51.174360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: fc7bb1a7-9a53-42b3-8205-cc1649a623f2 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:55:51.175664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port fc7bb1a7-9a53-42b3-8205-cc1649a623f2 updated. Details: {'device': 'fc7bb1a7-9a53-42b3-8205-cc1649a623f2', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-c3254d23-d48a-485d-a0e8-5f41e3baa079', 'network_id': 'c3254d23-d48a-485d-a0e8-5f41e3baa079', 'port_id': 'fc7bb1a7-9a53-42b3-8205-cc1649a623f2', 'mac_address': 'fa:16:3e:5a:0b:ce', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 96, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd4d50c9e-21e6-4b33-9f79-09c2d9887013', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 5} Sep 25 00:55:51.178149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapfc7bb1a7-9a, col_values=(('tag', 5),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:51.180704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapfc7bb1a7-9a, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:51.181769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapfc7bb1a7-9a, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:51.183012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:55:51.190289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapfc7bb1a7-9a, col_values=(('other_config', {'net_uuid': 'c3254d23-d48a-485d-a0e8-5f41e3baa079', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '96', 'tag': '5'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:51.191488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:55:51.198690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834de91,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 7}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:51.205521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 68a3f405-e599-4339-b2a8-058311132e20 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:55:51.206110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 68a3f405-e599-4339-b2a8-058311132e20 updated. Details: {'device': '68a3f405-e599-4339-b2a8-058311132e20', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-e04e78f2-fc42-4b3e-9ba5-62cef58448f8', 'network_id': 'e04e78f2-fc42-4b3e-9ba5-62cef58448f8', 'port_id': '68a3f405-e599-4339-b2a8-058311132e20', 'mac_address': 'fa:16:3e:34:39:6a', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 54, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6474d219-e5a1-4a6c-8e41-4afa0ca3d765', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 25 00:55:51.206677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Assigning 7 as local vlan for net-id=e04e78f2-fc42-4b3e-9ba5-62cef58448f8, seg-id=54 Sep 25 00:55:51.211095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xa5d7ab42,OFPFlowMod(buffer_id=4294967295,command=0,cookie=13979250796582379444,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4150), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4103}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:51.221584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x7834de93,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4103)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4150}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:51.226021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap68a3f405-e5, col_values=(('tag', 7),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:51.230510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap68a3f405-e5, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:51.231160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap68a3f405-e5, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:51.248032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap68a3f405-e5, col_values=(('other_config', {'net_uuid': 'e04e78f2-fc42-4b3e-9ba5-62cef58448f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '7', 'segmentation_id': '54'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:51.270498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834de95,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 10}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:51.271353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 8a22f42d-c327-4ae1-9e34-d8947d30272d {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:55:51.272064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 8a22f42d-c327-4ae1-9e34-d8947d30272d updated. Details: {'device': '8a22f42d-c327-4ae1-9e34-d8947d30272d', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-334cdfa6-14bd-4f9b-b93c-dbd866cdb6bb', 'network_id': '334cdfa6-14bd-4f9b-b93c-dbd866cdb6bb', 'port_id': '8a22f42d-c327-4ae1-9e34-d8947d30272d', 'mac_address': 'fa:16:3e:73:a2:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 87, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'cf3d0ae1-4d69-474f-b9d5-17c189ebf5ae', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 6} Sep 25 00:55:51.273343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap8a22f42d-c3, col_values=(('tag', 6),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:51.274039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap8a22f42d-c3, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:51.275303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap8a22f42d-c3, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:51.276072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:55:51.277876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap8a22f42d-c3, col_values=(('other_config', {'net_uuid': '334cdfa6-14bd-4f9b-b93c-dbd866cdb6bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '87', 'tag': '6'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:51.278781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:55:51.281619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834de97,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 8}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:51.282394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:252 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 9 devices currently available. Time elapsed: 0.119 Sep 25 00:55:51.282894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing device filters for 1 new devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 25 00:55:51.283353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing filters for devices {'68a3f405-e599-4339-b2a8-058311132e20'} Sep 25 00:55:51.287009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:55:51.287533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:55:51.292242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:55:51.367695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01e95da-5a08-4ff5-b3c9-0b895534b5ae]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:55:51.368709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refreshing firewall for 2 devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 25 00:55:51.369132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refresh firewall rules Sep 25 00:55:51.371833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:55:51.372127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:55:51.378806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 4 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:55:51.392126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Resource Port 0fd59bde-e230-44a6-9879-6a2bbb95a5fb updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=0fd59bde-e230-44a6-9879-6a2bbb95a5fb,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=0fd59bde-e230-44a6-9879-6a2bbb95a5fb,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)], 'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:55:51.392507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (0fd59bde-e230-44a6-9879-6a2bbb95a5fb), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:51.515407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[da377c7f-f567-42ab-a632-c0401fecdf14]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:55:51.516428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:252 - agent port security group processed in 0.353 Sep 25 00:55:51.517687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for fc7bb1a7-9a53-42b3-8205-cc1649a623f2 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:55:51.518665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 68a3f405-e599-4339-b2a8-058311132e20 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:55:51.519348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 8a22f42d-c327-4ae1-9e34-d8947d30272d to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:55:53.305054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3871091f-2618-44f9-8161-1cf4afc96a07 None None] Resource Port b6b39056-a691-4ac9-a565-574d1c5a0cd5 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=b6b39056-a691-4ac9-a565-574d1c5a0cd5,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=b6b39056-a691-4ac9-a565-574d1c5a0cd5,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:55:53.305988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3871091f-2618-44f9-8161-1cf4afc96a07 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (b6b39056-a691-4ac9-a565-574d1c5a0cd5), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:53.898676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-42f114af-0f30-429e-9290-0f33f0f5a39a admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:55:52Z,description='Default security group',id=8225d1c5-7e5f-4024-8090-ed62d0fc7b18,is_default=True,name='default',project_id='1bc1cab13abc43779d57421107671bdf',revision_number=1,rules=[SecurityGroupRule(a1a6ef1e-4878-4924-abd9-cec1fe6946dc),SecurityGroupRule(a90eca5f-df8b-4ce5-bacd-911ff337fa2b),SecurityGroupRule(c8aa9c6c-70c2-40db-808b-681ec9ee7441),SecurityGroupRule(e51e9216-8038-4a3f-b713-2487996cbfb9)],shared=False,stateful=True,updated_at=2022-09-25T00:55:53Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:53.901617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-42f114af-0f30-429e-9290-0f33f0f5a39a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (8225d1c5-7e5f-4024-8090-ed62d0fc7b18), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:53.903247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-42f114af-0f30-429e-9290-0f33f0f5a39a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:53Z,description=,direction='ingress',ethertype='IPv6',id=a1a6ef1e-4878-4924-abd9-cec1fe6946dc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1bc1cab13abc43779d57421107671bdf',protocol=,remote_address_group_id=,remote_group_id=8225d1c5-7e5f-4024-8090-ed62d0fc7b18,remote_ip_prefix=,revision_number=0,security_group_id=8225d1c5-7e5f-4024-8090-ed62d0fc7b18,updated_at=2022-09-25T00:55:53Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:53.904023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-42f114af-0f30-429e-9290-0f33f0f5a39a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (a1a6ef1e-4878-4924-abd9-cec1fe6946dc), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:53.904372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-42f114af-0f30-429e-9290-0f33f0f5a39a admin admin] Security group rule updated ['8225d1c5-7e5f-4024-8090-ed62d0fc7b18'] Sep 25 00:55:53.905220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-42f114af-0f30-429e-9290-0f33f0f5a39a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:53Z,description=,direction='egress',ethertype='IPv6',id=a90eca5f-df8b-4ce5-bacd-911ff337fa2b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1bc1cab13abc43779d57421107671bdf',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8225d1c5-7e5f-4024-8090-ed62d0fc7b18,updated_at=2022-09-25T00:55:53Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:53.905581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-42f114af-0f30-429e-9290-0f33f0f5a39a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (a90eca5f-df8b-4ce5-bacd-911ff337fa2b), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:53.906150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-42f114af-0f30-429e-9290-0f33f0f5a39a admin admin] Security group rule updated ['8225d1c5-7e5f-4024-8090-ed62d0fc7b18'] Sep 25 00:55:53.906811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-42f114af-0f30-429e-9290-0f33f0f5a39a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:53Z,description=,direction='egress',ethertype='IPv4',id=c8aa9c6c-70c2-40db-808b-681ec9ee7441,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1bc1cab13abc43779d57421107671bdf',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8225d1c5-7e5f-4024-8090-ed62d0fc7b18,updated_at=2022-09-25T00:55:53Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:53.907167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-42f114af-0f30-429e-9290-0f33f0f5a39a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (c8aa9c6c-70c2-40db-808b-681ec9ee7441), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:53.907492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-42f114af-0f30-429e-9290-0f33f0f5a39a admin admin] Security group rule updated ['8225d1c5-7e5f-4024-8090-ed62d0fc7b18'] Sep 25 00:55:53.908148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-42f114af-0f30-429e-9290-0f33f0f5a39a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:53Z,description=,direction='ingress',ethertype='IPv4',id=e51e9216-8038-4a3f-b713-2487996cbfb9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1bc1cab13abc43779d57421107671bdf',protocol=,remote_address_group_id=,remote_group_id=8225d1c5-7e5f-4024-8090-ed62d0fc7b18,remote_ip_prefix=,revision_number=0,security_group_id=8225d1c5-7e5f-4024-8090-ed62d0fc7b18,updated_at=2022-09-25T00:55:53Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:53.908497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-42f114af-0f30-429e-9290-0f33f0f5a39a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (e51e9216-8038-4a3f-b713-2487996cbfb9), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:53.909762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-42f114af-0f30-429e-9290-0f33f0f5a39a admin admin] Security group rule updated ['8225d1c5-7e5f-4024-8090-ed62d0fc7b18'] Sep 25 00:55:54.024709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Resource Port 68a3f405-e599-4339-b2a8-058311132e20 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:55:54.025812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (68a3f405-e599-4339-b2a8-058311132e20), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:54.115037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3871091f-2618-44f9-8161-1cf4afc96a07 None None] Resource Port b6b39056-a691-4ac9-a565-574d1c5a0cd5 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=b6b39056-a691-4ac9-a565-574d1c5a0cd5,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=b6b39056-a691-4ac9-a565-574d1c5a0cd5,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=b6b39056-a691-4ac9-a565-574d1c5a0cd5,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:55:54.116635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3871091f-2618-44f9-8161-1cf4afc96a07 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (b6b39056-a691-4ac9-a565-574d1c5a0cd5), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:54.204846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-441d984a-0b37-4923-9e23-789ddeead6eb admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:55:53Z,data_plane_status=None,description='',device_id='0366ab62-209a-4a0a-a198-da6587ec3f4a',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=1b8115fa-df9f-4b13-830a-866086f1b68f,mac_address=fa:16:3e:04:63:4a,name='',network_id=e04e78f2-fc42-4b3e-9ba5-62cef58448f8,numa_affinity_policy=,project_id='28568584195d475fbc52d76185e09044',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(1b8115fa-df9f-4b13-830a-866086f1b68f),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:55:53Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:54.205527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-441d984a-0b37-4923-9e23-789ddeead6eb admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (1b8115fa-df9f-4b13-830a-866086f1b68f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:54.303900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['fc7bb1a7-9a53-42b3-8205-cc1649a623f2', '68a3f405-e599-4339-b2a8-058311132e20', '8a22f42d-c327-4ae1-9e34-d8947d30272d'] and devices down [] completed. Sep 25 00:55:54.304239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:252 - ports processed. Elapsed:3.160 Sep 25 00:55:54.304578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:252 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 3, 'removed': 0}}. Elapsed:3.160 Sep 25 00:55:54.305849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Loop iteration exceeded interval (2 vs. 3.160071849822998)! {{(pid=107261) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Sep 25 00:55:54.307295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:253 started Sep 25 00:55:54.310466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de99,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=36000000,duration_sec=517,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:54.311385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:55:54.311874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:253 - starting polling. Elapsed:0.005 Sep 25 00:55:54.313881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:54.324644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:253 - port information retrieved. Elapsed:0.017 Sep 25 00:55:54.324985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'8a22f42d-c327-4ae1-9e34-d8947d30272d', '68a3f405-e599-4339-b2a8-058311132e20', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', 'fc7bb1a7-9a53-42b3-8205-cc1649a623f2', 'de4727a2-569d-44c6-a53e-ecc89817f610', '5204c0c3-4410-4695-a405-b599292c4e80'}, 'added': set(), 'removed': set(), 'updated': {'68a3f405-e599-4339-b2a8-058311132e20', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:55:54.328082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '68a3f405-e599-4339-b2a8-058311132e20', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-e04e78f2-fc42-4b3e-9ba5-62cef58448f8', 'network_id': 'e04e78f2-fc42-4b3e-9ba5-62cef58448f8', 'port_id': '68a3f405-e599-4339-b2a8-058311132e20', 'mac_address': 'fa:16:3e:34:39:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 54, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6474d219-e5a1-4a6c-8e41-4afa0ca3d765', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:55:54.330388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', 'device_id': '73160037-7787-46b1-aa0d-c30aa092a69a', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', 'mac_address': 'fa:16:3e:aa:4d:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.28'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:55:54.350621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 68a3f405-e599-4339-b2a8-058311132e20 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:55:54.351201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 68a3f405-e599-4339-b2a8-058311132e20 updated. Details: {'device': '68a3f405-e599-4339-b2a8-058311132e20', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-e04e78f2-fc42-4b3e-9ba5-62cef58448f8', 'network_id': 'e04e78f2-fc42-4b3e-9ba5-62cef58448f8', 'port_id': '68a3f405-e599-4339-b2a8-058311132e20', 'mac_address': 'fa:16:3e:34:39:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 54, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6474d219-e5a1-4a6c-8e41-4afa0ca3d765', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 7} Sep 25 00:55:54.353410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap68a3f405-e5, col_values=(('tag', 7),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:54.354039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap68a3f405-e5, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:54.354590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap68a3f405-e5, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:54.355185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:55:54.358097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap68a3f405-e5, col_values=(('other_config', {'net_uuid': 'e04e78f2-fc42-4b3e-9ba5-62cef58448f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '54', 'tag': '7'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:54.364330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:55:54.381774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834de9b,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 10}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:54.382200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 0fd59bde-e230-44a6-9879-6a2bbb95a5fb {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:55:54.382822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 0fd59bde-e230-44a6-9879-6a2bbb95a5fb updated. Details: {'device': '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', 'device_id': '73160037-7787-46b1-aa0d-c30aa092a69a', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', 'mac_address': 'fa:16:3e:aa:4d:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.28'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 25 00:55:54.384296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-0fd59bde-e2, col_values=(('tag', 2),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:54.384922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-0fd59bde-e2, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:54.387759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-0fd59bde-e2, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:54.388405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:55:54.394508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-0fd59bde-e2, col_values=(('other_config', {'net_uuid': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:54.396519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:55:54.405790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834de9d,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 9}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:54.408410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:253 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 9 devices currently available. Time elapsed: 0.081 Sep 25 00:55:54.415146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refreshing firewall for 2 devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 25 00:55:54.423062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refresh firewall rules Sep 25 00:55:54.426079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:55:54.426513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:55:54.440876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 4 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:55:54.538605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d0753cf2-deef-4db0-b1f5-ae98a7b18d73 None None] Resource Port eb9862a9-2d1e-4843-945a-d227bfbd9cd7 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=eb9862a9-2d1e-4843-945a-d227bfbd9cd7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=eb9862a9-2d1e-4843-945a-d227bfbd9cd7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:55:54.539198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d0753cf2-deef-4db0-b1f5-ae98a7b18d73 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (eb9862a9-2d1e-4843-945a-d227bfbd9cd7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:54.541653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c48d0a5-27b2-4307-b7a4-06f348411b8a]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:55:54.542326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:253 - agent port security group processed in 0.215 Sep 25 00:55:54.543319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 68a3f405-e599-4339-b2a8-058311132e20 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:55:54.543718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 0fd59bde-e230-44a6-9879-6a2bbb95a5fb to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:55:54.709688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7718cefc-f3f5-48be-b8be-6c756b076542 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:55:53Z,description='tempest-description--235078885',id=85a4d961-6b69-4634-b71f-daffd4a3d47f,is_default=False,name='tempest-securitygroup--208384066',project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',revision_number=1,rules=[SecurityGroupRule(1b0d16bc-03fd-44b3-880d-3cf977db4e82),SecurityGroupRule(f35ee64b-40c9-43dc-bbf2-ed1da88e1a4c)],shared=False,stateful=True,updated_at=2022-09-25T00:55:54Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:54.710255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7718cefc-f3f5-48be-b8be-6c756b076542 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (85a4d961-6b69-4634-b71f-daffd4a3d47f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:54.711060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7718cefc-f3f5-48be-b8be-6c756b076542 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:54Z,description=,direction='egress',ethertype='IPv6',id=1b0d16bc-03fd-44b3-880d-3cf977db4e82,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=85a4d961-6b69-4634-b71f-daffd4a3d47f,updated_at=2022-09-25T00:55:54Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:54.711657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7718cefc-f3f5-48be-b8be-6c756b076542 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (1b0d16bc-03fd-44b3-880d-3cf977db4e82), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:54.712218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-7718cefc-f3f5-48be-b8be-6c756b076542 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['85a4d961-6b69-4634-b71f-daffd4a3d47f'] Sep 25 00:55:54.713571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7718cefc-f3f5-48be-b8be-6c756b076542 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:54Z,description=,direction='egress',ethertype='IPv4',id=f35ee64b-40c9-43dc-bbf2-ed1da88e1a4c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=85a4d961-6b69-4634-b71f-daffd4a3d47f,updated_at=2022-09-25T00:55:54Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:54.714286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7718cefc-f3f5-48be-b8be-6c756b076542 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f35ee64b-40c9-43dc-bbf2-ed1da88e1a4c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:54.714913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-7718cefc-f3f5-48be-b8be-6c756b076542 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['85a4d961-6b69-4634-b71f-daffd4a3d47f'] Sep 25 00:55:54.794164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7e3c3413-d921-4a3a-b040-a7207568f3b9 admin admin] Resource SecurityGroup deleted: 8225d1c5-7e5f-4024-8090-ed62d0fc7b18 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:55:54.794868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7e3c3413-d921-4a3a-b040-a7207568f3b9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (8225d1c5-7e5f-4024-8090-ed62d0fc7b18), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:54.795363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e3c3413-d921-4a3a-b040-a7207568f3b9 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('8225d1c5-7e5f-4024-8090-ed62d0fc7b18',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:55:54.926876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-441d984a-0b37-4923-9e23-789ddeead6eb admin admin] Received resource Port update without any changes: 1b8115fa-df9f-4b13-830a-866086f1b68f {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 25 00:55:55.272044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7e3c3413-d921-4a3a-b040-a7207568f3b9 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('8225d1c5-7e5f-4024-8090-ed62d0fc7b18',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:55:55.272738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7e3c3413-d921-4a3a-b040-a7207568f3b9 admin admin] Resource SecurityGroupRule deleted: a1a6ef1e-4878-4924-abd9-cec1fe6946dc {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:55:55.273334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7e3c3413-d921-4a3a-b040-a7207568f3b9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (a1a6ef1e-4878-4924-abd9-cec1fe6946dc), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:55.274456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-7e3c3413-d921-4a3a-b040-a7207568f3b9 admin admin] Security group rule updated ['8225d1c5-7e5f-4024-8090-ed62d0fc7b18'] Sep 25 00:55:55.275368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7e3c3413-d921-4a3a-b040-a7207568f3b9 admin admin] Resource SecurityGroupRule deleted: a90eca5f-df8b-4ce5-bacd-911ff337fa2b {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:55:55.276116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7e3c3413-d921-4a3a-b040-a7207568f3b9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (a90eca5f-df8b-4ce5-bacd-911ff337fa2b), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:55.276664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-7e3c3413-d921-4a3a-b040-a7207568f3b9 admin admin] Security group rule updated ['8225d1c5-7e5f-4024-8090-ed62d0fc7b18'] Sep 25 00:55:55.277236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7e3c3413-d921-4a3a-b040-a7207568f3b9 admin admin] Resource SecurityGroupRule deleted: c8aa9c6c-70c2-40db-808b-681ec9ee7441 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:55:55.277807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7e3c3413-d921-4a3a-b040-a7207568f3b9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (c8aa9c6c-70c2-40db-808b-681ec9ee7441), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:55.278325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-7e3c3413-d921-4a3a-b040-a7207568f3b9 admin admin] Security group rule updated ['8225d1c5-7e5f-4024-8090-ed62d0fc7b18'] Sep 25 00:55:55.278908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7e3c3413-d921-4a3a-b040-a7207568f3b9 admin admin] Resource SecurityGroupRule deleted: e51e9216-8038-4a3f-b713-2487996cbfb9 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:55:55.279445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7e3c3413-d921-4a3a-b040-a7207568f3b9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (e51e9216-8038-4a3f-b713-2487996cbfb9), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:55.279973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-7e3c3413-d921-4a3a-b040-a7207568f3b9 admin admin] Security group rule updated ['8225d1c5-7e5f-4024-8090-ed62d0fc7b18'] Sep 25 00:55:55.341457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-58456424-3367-4cf0-87ca-481cad039c06 None None] Resource Port 7d521366-e68f-48bd-a7a8-e2283117a2b7 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=7d521366-e68f-48bd-a7a8-e2283117a2b7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=7d521366-e68f-48bd-a7a8-e2283117a2b7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:55:55.342094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-58456424-3367-4cf0-87ca-481cad039c06 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (7d521366-e68f-48bd-a7a8-e2283117a2b7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:55.363839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d56f3886-b4a8-4061-b21c-4775e0fda090 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:55:53Z,data_plane_status=None,description='',device_id='1756485f-d872-4799-a254-ef11e7f98682',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6,mac_address=fa:16:3e:ce:99:32,name='',network_id=c3254d23-d48a-485d-a0e8-5f41e3baa079,numa_affinity_policy=,project_id='5ca92ea462d24d2d8632e5c52a3dfe63',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:55:53Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:55.364307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d56f3886-b4a8-4061-b21c-4775e0fda090 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:55.643502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5b13494d-0faa-417c-b8b9-c0fa947a2c18 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:55:53Z,data_plane_status=None,description='',device_id='65efe4c7-23fe-404a-935b-071fd874df87',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=a08ec5e3-6360-432b-aa85-85ce1774998d,mac_address=fa:16:3e:a4:6c:86,name='',network_id=334cdfa6-14bd-4f9b-b93c-dbd866cdb6bb,numa_affinity_policy=,project_id='f09655506e354c9d991f4df9a92f4086',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(a08ec5e3-6360-432b-aa85-85ce1774998d),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:55:54Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:55.644146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5b13494d-0faa-417c-b8b9-c0fa947a2c18 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (a08ec5e3-6360-432b-aa85-85ce1774998d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:55.826732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e07188a2-e31c-4b9d-a59a-1ce4b2fd0c12 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:55Z,description='',direction='ingress',ethertype='IPv4',id=e783e066-813d-4e48-90be-3548b3839644,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=85a4d961-6b69-4634-b71f-daffd4a3d47f,updated_at=2022-09-25T00:55:55Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:55.827409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e07188a2-e31c-4b9d-a59a-1ce4b2fd0c12 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (e783e066-813d-4e48-90be-3548b3839644), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:55.827903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-e07188a2-e31c-4b9d-a59a-1ce4b2fd0c12 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['85a4d961-6b69-4634-b71f-daffd4a3d47f'] Sep 25 00:55:55.907876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0a41f8c5-b8eb-47bc-be92-3a576da54455","insert","qg-b6b39056-a6",["set",[]],["map",[["attached-mac","fa:16:3e:30:b6:c0"],["iface-id","b6b39056-a691-4ac9-a565-574d1c5a0cd5"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:55:55.932322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0a41f8c5-b8eb-47bc-be92-3a576da54455","old",null,["set",[]],null],["","new","qg-b6b39056-a6",11,["map",[["attached-mac","fa:16:3e:30:b6:c0"],["iface-id","b6b39056-a691-4ac9-a565-574d1c5a0cd5"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:55:56.130114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-da0f96b9-6d1c-4360-8e56-86a3f62d7714 None None] Resource Port a62d43a0-f84e-4f0c-bde1-8e3aa339843e updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=a62d43a0-f84e-4f0c-bde1-8e3aa339843e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a62d43a0-f84e-4f0c-bde1-8e3aa339843e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:55:56.130722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-da0f96b9-6d1c-4360-8e56-86a3f62d7714 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (a62d43a0-f84e-4f0c-bde1-8e3aa339843e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:56.490067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-03193a4d-f025-48b0-a3f9-4bad7af60c43 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:56Z,description='',direction='ingress',ethertype='IPv4',id=dbbc9e1c-2f1d-4d31-83f5-a6e8cc2643f2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=85a4d961-6b69-4634-b71f-daffd4a3d47f,updated_at=2022-09-25T00:55:56Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:56.490697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-03193a4d-f025-48b0-a3f9-4bad7af60c43 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (dbbc9e1c-2f1d-4d31-83f5-a6e8cc2643f2), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:56.490883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-03193a4d-f025-48b0-a3f9-4bad7af60c43 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['85a4d961-6b69-4634-b71f-daffd4a3d47f'] Sep 25 00:55:56.741802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d0753cf2-deef-4db0-b1f5-ae98a7b18d73 None None] Resource Port eb9862a9-2d1e-4843-945a-d227bfbd9cd7 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=eb9862a9-2d1e-4843-945a-d227bfbd9cd7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=eb9862a9-2d1e-4843-945a-d227bfbd9cd7,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=eb9862a9-2d1e-4843-945a-d227bfbd9cd7,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:55:56.742220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d0753cf2-deef-4db0-b1f5-ae98a7b18d73 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (eb9862a9-2d1e-4843-945a-d227bfbd9cd7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:56.950086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-58456424-3367-4cf0-87ca-481cad039c06 None None] Resource Port 7d521366-e68f-48bd-a7a8-e2283117a2b7 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=7d521366-e68f-48bd-a7a8-e2283117a2b7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=7d521366-e68f-48bd-a7a8-e2283117a2b7,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=7d521366-e68f-48bd-a7a8-e2283117a2b7,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:55:56.950496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-58456424-3367-4cf0-87ca-481cad039c06 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (7d521366-e68f-48bd-a7a8-e2283117a2b7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:57.060475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-da0f96b9-6d1c-4360-8e56-86a3f62d7714 None None] Resource Port a62d43a0-f84e-4f0c-bde1-8e3aa339843e updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a62d43a0-f84e-4f0c-bde1-8e3aa339843e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a62d43a0-f84e-4f0c-bde1-8e3aa339843e,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=a62d43a0-f84e-4f0c-bde1-8e3aa339843e,segment=NetworkSegment(32553459-8243-41b9-9fc0-bae9f5646e9f),segment_id=32553459-8243-41b9-9fc0-bae9f5646e9f)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:55:57.061000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-da0f96b9-6d1c-4360-8e56-86a3f62d7714 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (a62d43a0-f84e-4f0c-bde1-8e3aa339843e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:57.394675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["559165ca-87bb-4fa7-8992-049b5fd82c70","insert","qr-a62d43a0-f8",["set",[]],["map",[["attached-mac","fa:16:3e:18:22:67"],["iface-id","a62d43a0-f84e-4f0c-bde1-8e3aa339843e"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:55:57.416899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["559165ca-87bb-4fa7-8992-049b5fd82c70","old",null,["set",[]],null],["","new","qr-a62d43a0-f8",12,["map",[["attached-mac","fa:16:3e:18:22:67"],["iface-id","a62d43a0-f84e-4f0c-bde1-8e3aa339843e"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:55:57.934190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8b20ad10-737c-4e57-9643-1a1196f792f9","insert","qr-1b8115fa-df",["set",[]],["map",[["attached-mac","fa:16:3e:04:63:4a"],["iface-id","1b8115fa-df9f-4b13-830a-866086f1b68f"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:55:57.957998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-08e97a02-2214-4533-8396-7b0693037865 None None] Resource Port a62d43a0-f84e-4f0c-bde1-8e3aa339843e updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:55:57.961613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-08e97a02-2214-4533-8396-7b0693037865 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (a62d43a0-f84e-4f0c-bde1-8e3aa339843e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:57.971673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8b20ad10-737c-4e57-9643-1a1196f792f9","old",null,["set",[]],null],["","new","qr-1b8115fa-df",13,["map",[["attached-mac","fa:16:3e:04:63:4a"],["iface-id","1b8115fa-df9f-4b13-830a-866086f1b68f"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:55:58.014339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e3d98b7e-fc46-4ef1-908d-27c44570ca36 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:55:57Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=c677e0d1-0bfa-45ef-9888-f9884e48ddd2,mac_address=fa:16:3e:3c:e6:1e,name='',network_id=62195cd6-54fa-4e24-9d47-ae0de6356ac2,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(c677e0d1-0bfa-45ef-9888-f9884e48ddd2),security_group_ids=set([]),status='N/A',updated_at=2022-09-25T00:55:57Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:58.014756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e3d98b7e-fc46-4ef1-908d-27c44570ca36 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (c677e0d1-0bfa-45ef-9888-f9884e48ddd2), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:58.114776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['68a3f405-e599-4339-b2a8-058311132e20', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb'] and devices down [] completed. Sep 25 00:55:58.115347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:253 - ports processed. Elapsed:3.808 Sep 25 00:55:58.115905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:253 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 2, 'removed': 0}}. Elapsed:3.809 Sep 25 00:55:58.116763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Loop iteration exceeded interval (2 vs. 3.8085758686065674)! {{(pid=107261) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Sep 25 00:55:58.117204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:254 started Sep 25 00:55:58.122057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834de9f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=848000000,duration_sec=520,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:58.123619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:55:58.125334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:254 - starting polling. Elapsed:0.007 Sep 25 00:55:58.136240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:58.146706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:254 - port information retrieved. Elapsed:0.029 Sep 25 00:55:58.147828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'b6b39056-a691-4ac9-a565-574d1c5a0cd5', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '1b8115fa-df9f-4b13-830a-866086f1b68f', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '68a3f405-e599-4339-b2a8-058311132e20', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', 'fc7bb1a7-9a53-42b3-8205-cc1649a623f2', 'de4727a2-569d-44c6-a53e-ecc89817f610', '5204c0c3-4410-4695-a405-b599292c4e80'}, 'added': {'b6b39056-a691-4ac9-a565-574d1c5a0cd5', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '1b8115fa-df9f-4b13-830a-866086f1b68f'}, 'removed': set(), 'updated': {'a62d43a0-f84e-4f0c-bde1-8e3aa339843e'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:55:58.151028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': 'b6b39056-a691-4ac9-a565-574d1c5a0cd5', 'device_id': '1756485f-d872-4799-a254-ef11e7f98682', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': 'b6b39056-a691-4ac9-a565-574d1c5a0cd5', 'mac_address': 'fa:16:3e:30:b6:c0', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.26'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:55:58.151756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', 'device_id': '73160037-7787-46b1-aa0d-c30aa092a69a', 'network_id': '5dc49b54-686c-4619-ad4c-65c72c26fd31', 'port_id': 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', 'mac_address': 'fa:16:3e:18:22:67', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 71, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '0e647c01-1f0c-448e-8162-e47ee7cb9c90', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:55:58.152879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: WARNING neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:55:53Z,data_plane_status=None,description='',device_id='0366ab62-209a-4a0a-a198-da6587ec3f4a',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=1b8115fa-df9f-4b13-830a-866086f1b68f,mac_address=fa:16:3e:04:63:4a,name='',network_id=e04e78f2-fc42-4b3e-9ba5-62cef58448f8,numa_affinity_policy=,project_id='28568584195d475fbc52d76185e09044',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(1b8115fa-df9f-4b13-830a-866086f1b68f),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:55:54Z) is not bound. Sep 25 00:55:58.157278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: b6b39056-a691-4ac9-a565-574d1c5a0cd5 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:55:58.168468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port b6b39056-a691-4ac9-a565-574d1c5a0cd5 updated. Details: {'device': 'b6b39056-a691-4ac9-a565-574d1c5a0cd5', 'device_id': '1756485f-d872-4799-a254-ef11e7f98682', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': 'b6b39056-a691-4ac9-a565-574d1c5a0cd5', 'mac_address': 'fa:16:3e:30:b6:c0', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.26'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 25 00:55:58.172808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-b6b39056-a6, col_values=(('tag', 2),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:58.174667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-b6b39056-a6, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:58.175360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-b6b39056-a6, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:58.200169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5b13494d-0faa-417c-b8b9-c0fa947a2c18 admin admin] Received resource Port update without any changes: a08ec5e3-6360-432b-aa85-85ce1774998d {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 25 00:55:58.205276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-b6b39056-a6, col_values=(('other_config', {'net_uuid': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:58.241495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834dea1,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 11}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:58.247876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: a62d43a0-f84e-4f0c-bde1-8e3aa339843e {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:55:58.248335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port a62d43a0-f84e-4f0c-bde1-8e3aa339843e updated. Details: {'device': 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', 'device_id': '73160037-7787-46b1-aa0d-c30aa092a69a', 'network_id': '5dc49b54-686c-4619-ad4c-65c72c26fd31', 'port_id': 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', 'mac_address': 'fa:16:3e:18:22:67', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 71, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '0e647c01-1f0c-448e-8162-e47ee7cb9c90', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 4} Sep 25 00:55:58.257453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-a62d43a0-f8, col_values=(('tag', 4),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:58.258117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-a62d43a0-f8, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:58.259111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-a62d43a0-f8, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:58.280094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-a62d43a0-f8, col_values=(('other_config', {'net_uuid': '5dc49b54-686c-4619-ad4c-65c72c26fd31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '4', 'segmentation_id': '71'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:55:58.321578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834dea3,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 12}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:55:58.322497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 1b8115fa-df9f-4b13-830a-866086f1b68f {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:55:58.326978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Device 1b8115fa-df9f-4b13-830a-866086f1b68f not defined on plugin or binding failed Sep 25 00:55:58.327783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:254 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 12 devices currently available. Time elapsed: 0.178 Sep 25 00:55:58.328317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing device filters for 3 new devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 25 00:55:58.328783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing filters for devices {'b6b39056-a691-4ac9-a565-574d1c5a0cd5', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '1b8115fa-df9f-4b13-830a-866086f1b68f'} Sep 25 00:55:58.331144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:55:58.331623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:55:58.336287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 4 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:55:58.436142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec7e508-7c73-4b4e-a075-61c904695faf]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:55:58.436874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:254 - agent port security group processed in 0.287 Sep 25 00:55:58.437933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for b6b39056-a691-4ac9-a565-574d1c5a0cd5 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:55:58.438504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for a62d43a0-f84e-4f0c-bde1-8e3aa339843e to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:55:58.668391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5e2349b2-1bd8-478d-ab46-876bedf4071b","insert","qg-eb9862a9-2d",["set",[]],["map",[["attached-mac","fa:16:3e:49:5f:60"],["iface-id","eb9862a9-2d1e-4843-945a-d227bfbd9cd7"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:55:58.716705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5e2349b2-1bd8-478d-ab46-876bedf4071b","old",null,["set",[]],null],["","new","qg-eb9862a9-2d",14,["map",[["attached-mac","fa:16:3e:49:5f:60"],["iface-id","eb9862a9-2d1e-4843-945a-d227bfbd9cd7"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:55:58.934951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e3d98b7e-fc46-4ef1-908d-27c44570ca36 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource Port c677e0d1-0bfa-45ef-9888-f9884e48ddd2 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '037dd6c2-41d0-43d9-9277-d9fc08c10b1b'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:55:58.935532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e3d98b7e-fc46-4ef1-908d-27c44570ca36 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (c677e0d1-0bfa-45ef-9888-f9884e48ddd2), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:58.970452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d56f3886-b4a8-4061-b21c-4775e0fda090 admin admin] Received resource Port update without any changes: a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6 {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 25 00:55:59.265646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-dbbe2187-1234-4f96-a308-db7342b88db5 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:55:56Z,description='Default security group',id=514b8b17-ba94-44ff-83f7-d26ed33f2d75,is_default=True,name='default',project_id='67751478ae3a45f89000e9f561524d2c',revision_number=1,rules=[SecurityGroupRule(14a65982-696c-4cfc-9de0-b10da47ca64f),SecurityGroupRule(5ba2c57d-bc1c-4781-acb0-60680c91c5dc),SecurityGroupRule(cff04631-afb8-4068-b027-b079500d9c44),SecurityGroupRule(ef968546-5b63-40cf-a819-367ca06a7b53)],shared=False,stateful=True,updated_at=2022-09-25T00:55:57Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:59.266117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-dbbe2187-1234-4f96-a308-db7342b88db5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (514b8b17-ba94-44ff-83f7-d26ed33f2d75), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:59.267013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-dbbe2187-1234-4f96-a308-db7342b88db5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:57Z,description=,direction='egress',ethertype='IPv6',id=14a65982-696c-4cfc-9de0-b10da47ca64f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='67751478ae3a45f89000e9f561524d2c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=514b8b17-ba94-44ff-83f7-d26ed33f2d75,updated_at=2022-09-25T00:55:57Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:59.267392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-dbbe2187-1234-4f96-a308-db7342b88db5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (14a65982-696c-4cfc-9de0-b10da47ca64f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:59.267781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-dbbe2187-1234-4f96-a308-db7342b88db5 admin admin] Security group rule updated ['514b8b17-ba94-44ff-83f7-d26ed33f2d75'] Sep 25 00:55:59.269372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-dbbe2187-1234-4f96-a308-db7342b88db5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:57Z,description=,direction='ingress',ethertype='IPv6',id=5ba2c57d-bc1c-4781-acb0-60680c91c5dc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='67751478ae3a45f89000e9f561524d2c',protocol=,remote_address_group_id=,remote_group_id=514b8b17-ba94-44ff-83f7-d26ed33f2d75,remote_ip_prefix=,revision_number=0,security_group_id=514b8b17-ba94-44ff-83f7-d26ed33f2d75,updated_at=2022-09-25T00:55:57Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:59.269761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-dbbe2187-1234-4f96-a308-db7342b88db5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (5ba2c57d-bc1c-4781-acb0-60680c91c5dc), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:59.270117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-dbbe2187-1234-4f96-a308-db7342b88db5 admin admin] Security group rule updated ['514b8b17-ba94-44ff-83f7-d26ed33f2d75'] Sep 25 00:55:59.273198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-dbbe2187-1234-4f96-a308-db7342b88db5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:57Z,description=,direction='ingress',ethertype='IPv4',id=cff04631-afb8-4068-b027-b079500d9c44,normalized_cidr=None,port_range_max=,port_range_min=,project_id='67751478ae3a45f89000e9f561524d2c',protocol=,remote_address_group_id=,remote_group_id=514b8b17-ba94-44ff-83f7-d26ed33f2d75,remote_ip_prefix=,revision_number=0,security_group_id=514b8b17-ba94-44ff-83f7-d26ed33f2d75,updated_at=2022-09-25T00:55:57Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:59.277433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-dbbe2187-1234-4f96-a308-db7342b88db5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (cff04631-afb8-4068-b027-b079500d9c44), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:59.278681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-dbbe2187-1234-4f96-a308-db7342b88db5 admin admin] Security group rule updated ['514b8b17-ba94-44ff-83f7-d26ed33f2d75'] Sep 25 00:55:59.295788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-dbbe2187-1234-4f96-a308-db7342b88db5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:55:57Z,description=,direction='egress',ethertype='IPv4',id=ef968546-5b63-40cf-a819-367ca06a7b53,normalized_cidr=None,port_range_max=,port_range_min=,project_id='67751478ae3a45f89000e9f561524d2c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=514b8b17-ba94-44ff-83f7-d26ed33f2d75,updated_at=2022-09-25T00:55:57Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:55:59.298518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-dbbe2187-1234-4f96-a308-db7342b88db5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (ef968546-5b63-40cf-a819-367ca06a7b53), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:59.299308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-dbbe2187-1234-4f96-a308-db7342b88db5 admin admin] Security group rule updated ['514b8b17-ba94-44ff-83f7-d26ed33f2d75'] Sep 25 00:55:59.343290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Resource Port b6b39056-a691-4ac9-a565-574d1c5a0cd5 updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=b6b39056-a691-4ac9-a565-574d1c5a0cd5,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=b6b39056-a691-4ac9-a565-574d1c5a0cd5,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)], 'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:55:59.344169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (b6b39056-a691-4ac9-a565-574d1c5a0cd5), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:55:59.529741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['b6b39056-a691-4ac9-a565-574d1c5a0cd5', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e'] and devices down [] completed. Sep 25 00:55:59.530672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:254 - ports processed. Elapsed:1.413 Sep 25 00:55:59.531012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:254 completed. Processed ports statistics: {'regular': {'added': 3, 'updated': 1, 'removed': 0}}. Elapsed:1.414 Sep 25 00:55:59.617303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["93298607-c556-4163-b1f8-95044cb36979","insert","qg-7d521366-e6",["set",[]],["map",[["attached-mac","fa:16:3e:10:d9:d3"],["iface-id","7d521366-e68f-48bd-a7a8-e2283117a2b7"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:55:59.619923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["93298607-c556-4163-b1f8-95044cb36979","old",null,["set",[]],null],["","new","qg-7d521366-e6",15,["map",[["attached-mac","fa:16:3e:10:d9:d3"],["iface-id","7d521366-e68f-48bd-a7a8-e2283117a2b7"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:56:00.118726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:255 started Sep 25 00:56:00.122097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dea5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=847000000,duration_sec=522,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:00.122898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:56:00.123452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:255 - starting polling. Elapsed:0.005 Sep 25 00:56:00.125650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:00.128474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:255 - port information retrieved. Elapsed:0.010 Sep 25 00:56:00.128812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'b6b39056-a691-4ac9-a565-574d1c5a0cd5', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '1b8115fa-df9f-4b13-830a-866086f1b68f', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '68a3f405-e599-4339-b2a8-058311132e20', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', '7d521366-e68f-48bd-a7a8-e2283117a2b7', 'fc7bb1a7-9a53-42b3-8205-cc1649a623f2', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'de4727a2-569d-44c6-a53e-ecc89817f610', '5204c0c3-4410-4695-a405-b599292c4e80'}, 'added': {'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', '7d521366-e68f-48bd-a7a8-e2283117a2b7'}, 'removed': set(), 'updated': {'b6b39056-a691-4ac9-a565-574d1c5a0cd5'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:56:00.149645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': 'b6b39056-a691-4ac9-a565-574d1c5a0cd5', 'device_id': '1756485f-d872-4799-a254-ef11e7f98682', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': 'b6b39056-a691-4ac9-a565-574d1c5a0cd5', 'mac_address': 'fa:16:3e:30:b6:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.26'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:56:00.150735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'device_id': '65efe4c7-23fe-404a-935b-071fd874df87', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'mac_address': 'fa:16:3e:49:5f:60', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.204'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:56:00.151237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '7d521366-e68f-48bd-a7a8-e2283117a2b7', 'device_id': '0366ab62-209a-4a0a-a198-da6587ec3f4a', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': '7d521366-e68f-48bd-a7a8-e2283117a2b7', 'mac_address': 'fa:16:3e:10:d9:d3', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.234'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:56:00.176728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: b6b39056-a691-4ac9-a565-574d1c5a0cd5 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:56:00.177175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port b6b39056-a691-4ac9-a565-574d1c5a0cd5 updated. Details: {'device': 'b6b39056-a691-4ac9-a565-574d1c5a0cd5', 'device_id': '1756485f-d872-4799-a254-ef11e7f98682', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': 'b6b39056-a691-4ac9-a565-574d1c5a0cd5', 'mac_address': 'fa:16:3e:30:b6:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.26'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 25 00:56:00.178354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-b6b39056-a6, col_values=(('tag', 2),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:00.178806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-b6b39056-a6, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:00.182273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-b6b39056-a6, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:00.189561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:56:00.193027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-b6b39056-a6, col_values=(('other_config', {'net_uuid': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:00.196177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:56:00.209720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834dea7,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 11}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:00.210089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: eb9862a9-2d1e-4843-945a-d227bfbd9cd7 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:56:00.210429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port eb9862a9-2d1e-4843-945a-d227bfbd9cd7 updated. Details: {'device': 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'device_id': '65efe4c7-23fe-404a-935b-071fd874df87', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'mac_address': 'fa:16:3e:49:5f:60', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.204'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 25 00:56:00.211818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-eb9862a9-2d, col_values=(('tag', 2),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:00.212427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-eb9862a9-2d, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:00.212581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-eb9862a9-2d, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:00.222121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-eb9862a9-2d, col_values=(('other_config', {'net_uuid': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:00.239628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834dea9,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 14}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:00.240807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 7d521366-e68f-48bd-a7a8-e2283117a2b7 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:56:00.243656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 7d521366-e68f-48bd-a7a8-e2283117a2b7 updated. Details: {'device': '7d521366-e68f-48bd-a7a8-e2283117a2b7', 'device_id': '0366ab62-209a-4a0a-a198-da6587ec3f4a', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': '7d521366-e68f-48bd-a7a8-e2283117a2b7', 'mac_address': 'fa:16:3e:10:d9:d3', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.234'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 25 00:56:00.250714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-7d521366-e6, col_values=(('tag', 2),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:00.251372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-7d521366-e6, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:00.251984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-7d521366-e6, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:00.266254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-7d521366-e6, col_values=(('other_config', {'net_uuid': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:00.287416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834deab,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 15}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:00.289817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:255 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 14 devices currently available. Time elapsed: 0.160 Sep 25 00:56:00.290267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing device filters for 2 new devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 25 00:56:00.290544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing filters for devices {'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', '7d521366-e68f-48bd-a7a8-e2283117a2b7'} Sep 25 00:56:00.292300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:56:00.292661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:56:00.298001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 4 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:56:00.397453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d1f9fd-9e2f-460f-a4ed-44a8b4a3ef30]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:56:00.398501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refreshing firewall for 1 devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 25 00:56:00.399095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refresh firewall rules Sep 25 00:56:00.400841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:56:00.401504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:56:00.418574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:56:00.564171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0de6c1-6f04-4e7b-b1b3-38c227eebe01]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:56:00.564801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:255 - agent port security group processed in 0.436 Sep 25 00:56:00.565965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for b6b39056-a691-4ac9-a565-574d1c5a0cd5 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:56:00.566614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for eb9862a9-2d1e-4843-945a-d227bfbd9cd7 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:56:00.567345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 7d521366-e68f-48bd-a7a8-e2283117a2b7 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:56:01.019240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6ae3c693-1332-4ac9-929e-f5f2096d30e4 admin admin] Resource SecurityGroup deleted: 514b8b17-ba94-44ff-83f7-d26ed33f2d75 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:01.019696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6ae3c693-1332-4ac9-929e-f5f2096d30e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (514b8b17-ba94-44ff-83f7-d26ed33f2d75), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:01.020466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ae3c693-1332-4ac9-929e-f5f2096d30e4 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('514b8b17-ba94-44ff-83f7-d26ed33f2d75',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:56:01.145952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6ae3c693-1332-4ac9-929e-f5f2096d30e4 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('514b8b17-ba94-44ff-83f7-d26ed33f2d75',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:56:01.146550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6ae3c693-1332-4ac9-929e-f5f2096d30e4 admin admin] Resource SecurityGroupRule deleted: 14a65982-696c-4cfc-9de0-b10da47ca64f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:01.146846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6ae3c693-1332-4ac9-929e-f5f2096d30e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (14a65982-696c-4cfc-9de0-b10da47ca64f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:01.147174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-6ae3c693-1332-4ac9-929e-f5f2096d30e4 admin admin] Security group rule updated ['514b8b17-ba94-44ff-83f7-d26ed33f2d75'] Sep 25 00:56:01.147792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6ae3c693-1332-4ac9-929e-f5f2096d30e4 admin admin] Resource SecurityGroupRule deleted: 5ba2c57d-bc1c-4781-acb0-60680c91c5dc {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:01.148297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6ae3c693-1332-4ac9-929e-f5f2096d30e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (5ba2c57d-bc1c-4781-acb0-60680c91c5dc), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:01.149377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-6ae3c693-1332-4ac9-929e-f5f2096d30e4 admin admin] Security group rule updated ['514b8b17-ba94-44ff-83f7-d26ed33f2d75'] Sep 25 00:56:01.150408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6ae3c693-1332-4ac9-929e-f5f2096d30e4 admin admin] Resource SecurityGroupRule deleted: cff04631-afb8-4068-b027-b079500d9c44 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:01.150914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6ae3c693-1332-4ac9-929e-f5f2096d30e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (cff04631-afb8-4068-b027-b079500d9c44), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:01.151382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-6ae3c693-1332-4ac9-929e-f5f2096d30e4 admin admin] Security group rule updated ['514b8b17-ba94-44ff-83f7-d26ed33f2d75'] Sep 25 00:56:01.152022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6ae3c693-1332-4ac9-929e-f5f2096d30e4 admin admin] Resource SecurityGroupRule deleted: ef968546-5b63-40cf-a819-367ca06a7b53 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:01.152521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6ae3c693-1332-4ac9-929e-f5f2096d30e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (ef968546-5b63-40cf-a819-367ca06a7b53), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:01.153505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-6ae3c693-1332-4ac9-929e-f5f2096d30e4 admin admin] Security group rule updated ['514b8b17-ba94-44ff-83f7-d26ed33f2d75'] Sep 25 00:56:01.621093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Resource Port eb9862a9-2d1e-4843-945a-d227bfbd9cd7 updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=eb9862a9-2d1e-4843-945a-d227bfbd9cd7,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=eb9862a9-2d1e-4843-945a-d227bfbd9cd7,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)], 'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:01.624421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (eb9862a9-2d1e-4843-945a-d227bfbd9cd7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:01.989548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['b6b39056-a691-4ac9-a565-574d1c5a0cd5', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', '7d521366-e68f-48bd-a7a8-e2283117a2b7'] and devices down [] completed. Sep 25 00:56:01.989874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:255 - ports processed. Elapsed:1.871 Sep 25 00:56:01.990236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:255 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 1, 'removed': 0}}. Elapsed:1.872 Sep 25 00:56:02.106353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Resource Port 7d521366-e68f-48bd-a7a8-e2283117a2b7 updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=7d521366-e68f-48bd-a7a8-e2283117a2b7,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=7d521366-e68f-48bd-a7a8-e2283117a2b7,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)], 'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:02.106743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (7d521366-e68f-48bd-a7a8-e2283117a2b7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:02.125095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:256 started Sep 25 00:56:02.127473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dead,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=849000000,duration_sec=524,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:02.130515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:56:02.133952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:256 - starting polling. Elapsed:0.013 Sep 25 00:56:02.138099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:02.151807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:256 - port information retrieved. Elapsed:0.030 Sep 25 00:56:02.152381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'b6b39056-a691-4ac9-a565-574d1c5a0cd5', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '1b8115fa-df9f-4b13-830a-866086f1b68f', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '68a3f405-e599-4339-b2a8-058311132e20', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', '7d521366-e68f-48bd-a7a8-e2283117a2b7', 'fc7bb1a7-9a53-42b3-8205-cc1649a623f2', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'de4727a2-569d-44c6-a53e-ecc89817f610', '5204c0c3-4410-4695-a405-b599292c4e80'}, 'added': set(), 'removed': set(), 'updated': {'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', '7d521366-e68f-48bd-a7a8-e2283117a2b7'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:56:02.154279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'device_id': '65efe4c7-23fe-404a-935b-071fd874df87', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'mac_address': 'fa:16:3e:49:5f:60', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.204'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:56:02.155952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '7d521366-e68f-48bd-a7a8-e2283117a2b7', 'device_id': '0366ab62-209a-4a0a-a198-da6587ec3f4a', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': '7d521366-e68f-48bd-a7a8-e2283117a2b7', 'mac_address': 'fa:16:3e:10:d9:d3', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.234'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:56:02.163920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: eb9862a9-2d1e-4843-945a-d227bfbd9cd7 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:56:02.164872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port eb9862a9-2d1e-4843-945a-d227bfbd9cd7 updated. Details: {'device': 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'device_id': '65efe4c7-23fe-404a-935b-071fd874df87', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'mac_address': 'fa:16:3e:49:5f:60', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.204'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 25 00:56:02.167277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-eb9862a9-2d, col_values=(('tag', 2),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:02.168376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-eb9862a9-2d, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:02.169522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-eb9862a9-2d, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:02.170307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:56:02.172414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-eb9862a9-2d, col_values=(('other_config', {'net_uuid': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:02.173316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:56:02.178176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834deaf,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 14}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:02.178914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 7d521366-e68f-48bd-a7a8-e2283117a2b7 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:56:02.179451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 7d521366-e68f-48bd-a7a8-e2283117a2b7 updated. Details: {'device': '7d521366-e68f-48bd-a7a8-e2283117a2b7', 'device_id': '0366ab62-209a-4a0a-a198-da6587ec3f4a', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': '7d521366-e68f-48bd-a7a8-e2283117a2b7', 'mac_address': 'fa:16:3e:10:d9:d3', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.234'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 25 00:56:02.182141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-7d521366-e6, col_values=(('tag', 2),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:02.182948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-7d521366-e6, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:02.183556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-7d521366-e6, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:02.184485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:56:02.186853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-7d521366-e6, col_values=(('other_config', {'net_uuid': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:02.188115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:56:02.200578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834deb1,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 15}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:02.201316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:256 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 14 devices currently available. Time elapsed: 0.049 Sep 25 00:56:02.202197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refreshing firewall for 2 devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 25 00:56:02.202779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refresh firewall rules Sep 25 00:56:02.204920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:56:02.205492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:56:02.212303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 4 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:56:02.312141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27108ec-1dc6-4b4f-b7be-fab0649bd7aa]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:56:02.314083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:256 - agent port security group processed in 0.161 Sep 25 00:56:02.315815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for eb9862a9-2d1e-4843-945a-d227bfbd9cd7 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:56:02.317741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 7d521366-e68f-48bd-a7a8-e2283117a2b7 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:56:02.615275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-44dd671f-4138-4000-b912-00a70000c233 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:02Z,description='tempest-description--1143590354',id=e1c787d9-5e00-43b4-af6c-89d3769b8873,is_default=False,name='tempest-securitygroup--460209066',project_id='f09655506e354c9d991f4df9a92f4086',revision_number=1,rules=[SecurityGroupRule(a82bdaa7-d9d4-4b56-a6a8-982a80151fb0),SecurityGroupRule(ae9e1c7d-c79b-4600-bb87-8054e454fe8e)],shared=False,stateful=True,updated_at=2022-09-25T00:56:02Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:02.615840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-44dd671f-4138-4000-b912-00a70000c233 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (e1c787d9-5e00-43b4-af6c-89d3769b8873), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:02.618169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-44dd671f-4138-4000-b912-00a70000c233 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:02Z,description=,direction='egress',ethertype='IPv4',id=a82bdaa7-d9d4-4b56-a6a8-982a80151fb0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f09655506e354c9d991f4df9a92f4086',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e1c787d9-5e00-43b4-af6c-89d3769b8873,updated_at=2022-09-25T00:56:02Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:02.618865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-44dd671f-4138-4000-b912-00a70000c233 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (a82bdaa7-d9d4-4b56-a6a8-982a80151fb0), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:02.619368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-44dd671f-4138-4000-b912-00a70000c233 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Security group rule updated ['e1c787d9-5e00-43b4-af6c-89d3769b8873'] Sep 25 00:56:02.620223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-44dd671f-4138-4000-b912-00a70000c233 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:02Z,description=,direction='egress',ethertype='IPv6',id=ae9e1c7d-c79b-4600-bb87-8054e454fe8e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f09655506e354c9d991f4df9a92f4086',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e1c787d9-5e00-43b4-af6c-89d3769b8873,updated_at=2022-09-25T00:56:02Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:02.620768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-44dd671f-4138-4000-b912-00a70000c233 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (ae9e1c7d-c79b-4600-bb87-8054e454fe8e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:02.621535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-44dd671f-4138-4000-b912-00a70000c233 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Security group rule updated ['e1c787d9-5e00-43b4-af6c-89d3769b8873'] Sep 25 00:56:03.215784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9356fb05-2e69-48b0-b521-0e8d2e5ee52f tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:02Z,description='',direction='ingress',ethertype='IPv4',id=dbbc07ab-f006-4c49-bc17-3317e1021669,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='f09655506e354c9d991f4df9a92f4086',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e1c787d9-5e00-43b4-af6c-89d3769b8873,updated_at=2022-09-25T00:56:02Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:03.216522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9356fb05-2e69-48b0-b521-0e8d2e5ee52f tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (dbbc07ab-f006-4c49-bc17-3317e1021669), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:03.216522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9356fb05-2e69-48b0-b521-0e8d2e5ee52f tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Security group rule updated ['e1c787d9-5e00-43b4-af6c-89d3769b8873'] Sep 25 00:56:03.512356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-706c8c61-647c-44e8-9d6f-2ec8e05cb2a8 None None] Resource Port a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:03.513312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-706c8c61-647c-44e8-9d6f-2ec8e05cb2a8 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:04.029734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f7fe5215-8cdd-4e57-8ad1-d64735a17bf9 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:03Z,description='',direction='ingress',ethertype='IPv4',id=0ea8217a-556f-4b0c-862c-afdc35061ba9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f09655506e354c9d991f4df9a92f4086',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e1c787d9-5e00-43b4-af6c-89d3769b8873,updated_at=2022-09-25T00:56:03Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:04.030270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f7fe5215-8cdd-4e57-8ad1-d64735a17bf9 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (0ea8217a-556f-4b0c-862c-afdc35061ba9), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:04.030829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f7fe5215-8cdd-4e57-8ad1-d64735a17bf9 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Security group rule updated ['e1c787d9-5e00-43b4-af6c-89d3769b8873'] Sep 25 00:56:04.323345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['eb9862a9-2d1e-4843-945a-d227bfbd9cd7', '7d521366-e68f-48bd-a7a8-e2283117a2b7'] and devices down [] completed. Sep 25 00:56:04.324011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:256 - ports processed. Elapsed:2.204 Sep 25 00:56:04.328768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:256 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 2, 'removed': 0}}. Elapsed:2.204 Sep 25 00:56:04.329681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Loop iteration exceeded interval (2 vs. 2.2039406299591064)! {{(pid=107261) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Sep 25 00:56:04.330157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:257 started Sep 25 00:56:04.340875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834deb3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=59000000,duration_sec=527,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:04.349069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:56:04.349726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:257 - starting polling. Elapsed:0.020 Sep 25 00:56:04.366671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:04.384069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:257 - port information retrieved. Elapsed:0.053 Sep 25 00:56:04.384844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:257 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.055 Sep 25 00:56:05.037887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-706c8c61-647c-44e8-9d6f-2ec8e05cb2a8 None None] Resource Port a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6,segment=NetworkSegment(47b88da7-e2fb-4714-bbd5-a18aae097f49),segment_id=47b88da7-e2fb-4714-bbd5-a18aae097f49)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:05.038309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-706c8c61-647c-44e8-9d6f-2ec8e05cb2a8 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:06.113963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2aa78590-097e-4237-8dab-23562281ccdf admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:05Z,description='Default security group',id=e1b9c040-9c9b-4bed-8f7d-942a2f55c696,is_default=True,name='default',project_id='03e39e5230b1454197fb977b74b18596',revision_number=1,rules=[SecurityGroupRule(1116b691-033b-4a80-9ed1-bf1a976f9206),SecurityGroupRule(2ba3f043-78a8-4b25-81ec-7aae133b2167),SecurityGroupRule(7d635ab5-6003-4c17-9f09-d2481528f27a),SecurityGroupRule(bf216425-cb0c-4820-8c7c-d587908d4663)],shared=False,stateful=True,updated_at=2022-09-25T00:56:05Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:06.114606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2aa78590-097e-4237-8dab-23562281ccdf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (e1b9c040-9c9b-4bed-8f7d-942a2f55c696), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:06.114989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2aa78590-097e-4237-8dab-23562281ccdf admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:05Z,description=,direction='ingress',ethertype='IPv6',id=1116b691-033b-4a80-9ed1-bf1a976f9206,normalized_cidr=None,port_range_max=,port_range_min=,project_id='03e39e5230b1454197fb977b74b18596',protocol=,remote_address_group_id=,remote_group_id=e1b9c040-9c9b-4bed-8f7d-942a2f55c696,remote_ip_prefix=,revision_number=0,security_group_id=e1b9c040-9c9b-4bed-8f7d-942a2f55c696,updated_at=2022-09-25T00:56:05Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:06.115359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2aa78590-097e-4237-8dab-23562281ccdf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (1116b691-033b-4a80-9ed1-bf1a976f9206), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:06.120371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2aa78590-097e-4237-8dab-23562281ccdf admin admin] Security group rule updated ['e1b9c040-9c9b-4bed-8f7d-942a2f55c696'] Sep 25 00:56:06.121293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2aa78590-097e-4237-8dab-23562281ccdf admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:05Z,description=,direction='egress',ethertype='IPv6',id=2ba3f043-78a8-4b25-81ec-7aae133b2167,normalized_cidr=None,port_range_max=,port_range_min=,project_id='03e39e5230b1454197fb977b74b18596',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e1b9c040-9c9b-4bed-8f7d-942a2f55c696,updated_at=2022-09-25T00:56:05Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:06.125682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2aa78590-097e-4237-8dab-23562281ccdf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (2ba3f043-78a8-4b25-81ec-7aae133b2167), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:06.128965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2aa78590-097e-4237-8dab-23562281ccdf admin admin] Security group rule updated ['e1b9c040-9c9b-4bed-8f7d-942a2f55c696'] Sep 25 00:56:06.129779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2aa78590-097e-4237-8dab-23562281ccdf admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:05Z,description=,direction='ingress',ethertype='IPv4',id=7d635ab5-6003-4c17-9f09-d2481528f27a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='03e39e5230b1454197fb977b74b18596',protocol=,remote_address_group_id=,remote_group_id=e1b9c040-9c9b-4bed-8f7d-942a2f55c696,remote_ip_prefix=,revision_number=0,security_group_id=e1b9c040-9c9b-4bed-8f7d-942a2f55c696,updated_at=2022-09-25T00:56:05Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:06.130158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2aa78590-097e-4237-8dab-23562281ccdf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (7d635ab5-6003-4c17-9f09-d2481528f27a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:06.130499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2aa78590-097e-4237-8dab-23562281ccdf admin admin] Security group rule updated ['e1b9c040-9c9b-4bed-8f7d-942a2f55c696'] Sep 25 00:56:06.135012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2aa78590-097e-4237-8dab-23562281ccdf admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:05Z,description=,direction='egress',ethertype='IPv4',id=bf216425-cb0c-4820-8c7c-d587908d4663,normalized_cidr=None,port_range_max=,port_range_min=,project_id='03e39e5230b1454197fb977b74b18596',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e1b9c040-9c9b-4bed-8f7d-942a2f55c696,updated_at=2022-09-25T00:56:05Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:06.135479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2aa78590-097e-4237-8dab-23562281ccdf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (bf216425-cb0c-4820-8c7c-d587908d4663), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:06.141208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2aa78590-097e-4237-8dab-23562281ccdf admin admin] Security group rule updated ['e1b9c040-9c9b-4bed-8f7d-942a2f55c696'] Sep 25 00:56:06.159404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-81275f59-8e32-4ca2-9580-57de01a706ff tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:56:04Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=3be19e53-1051-400f-988a-21c11c99e045,mac_address=fa:16:3e:6c:e3:04,name='',network_id=62195cd6-54fa-4e24-9d47-ae0de6356ac2,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(3be19e53-1051-400f-988a-21c11c99e045),security_group_ids=set([]),status='N/A',updated_at=2022-09-25T00:56:05Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:06.159819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-81275f59-8e32-4ca2-9580-57de01a706ff tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (3be19e53-1051-400f-988a-21c11c99e045), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:06.331477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:258 started Sep 25 00:56:06.335272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834deb5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=60000000,duration_sec=529,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:06.336873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:56:06.337810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:258 - starting polling. Elapsed:0.006 Sep 25 00:56:06.340451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:06.344344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:258 - port information retrieved. Elapsed:0.013 Sep 25 00:56:06.348279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:258 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Sep 25 00:56:06.417699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4235a3d3-3449-42cd-a821-c1fbccdc1401 admin admin] Resource SecurityGroup deleted: e1b9c040-9c9b-4bed-8f7d-942a2f55c696 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:06.418314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4235a3d3-3449-42cd-a821-c1fbccdc1401 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (e1b9c040-9c9b-4bed-8f7d-942a2f55c696), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:06.418961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4235a3d3-3449-42cd-a821-c1fbccdc1401 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e1b9c040-9c9b-4bed-8f7d-942a2f55c696',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:56:06.636226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d0934286-f6d4-4289-b350-e63dbb65f933 None None] Resource Port a08ec5e3-6360-432b-aa85-85ce1774998d updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=a08ec5e3-6360-432b-aa85-85ce1774998d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a08ec5e3-6360-432b-aa85-85ce1774998d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:06.637075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d0934286-f6d4-4289-b350-e63dbb65f933 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (a08ec5e3-6360-432b-aa85-85ce1774998d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:06.670897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4235a3d3-3449-42cd-a821-c1fbccdc1401 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e1b9c040-9c9b-4bed-8f7d-942a2f55c696',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:56:06.675093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4235a3d3-3449-42cd-a821-c1fbccdc1401 admin admin] Resource SecurityGroupRule deleted: 1116b691-033b-4a80-9ed1-bf1a976f9206 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:06.675658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4235a3d3-3449-42cd-a821-c1fbccdc1401 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (1116b691-033b-4a80-9ed1-bf1a976f9206), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:06.676155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-4235a3d3-3449-42cd-a821-c1fbccdc1401 admin admin] Security group rule updated ['e1b9c040-9c9b-4bed-8f7d-942a2f55c696'] Sep 25 00:56:06.676879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4235a3d3-3449-42cd-a821-c1fbccdc1401 admin admin] Resource SecurityGroupRule deleted: 2ba3f043-78a8-4b25-81ec-7aae133b2167 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:06.678073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4235a3d3-3449-42cd-a821-c1fbccdc1401 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (2ba3f043-78a8-4b25-81ec-7aae133b2167), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:06.678623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-4235a3d3-3449-42cd-a821-c1fbccdc1401 admin admin] Security group rule updated ['e1b9c040-9c9b-4bed-8f7d-942a2f55c696'] Sep 25 00:56:06.680201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4235a3d3-3449-42cd-a821-c1fbccdc1401 admin admin] Resource SecurityGroupRule deleted: 7d635ab5-6003-4c17-9f09-d2481528f27a {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:06.680929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4235a3d3-3449-42cd-a821-c1fbccdc1401 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (7d635ab5-6003-4c17-9f09-d2481528f27a), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:06.681621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-4235a3d3-3449-42cd-a821-c1fbccdc1401 admin admin] Security group rule updated ['e1b9c040-9c9b-4bed-8f7d-942a2f55c696'] Sep 25 00:56:06.682231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4235a3d3-3449-42cd-a821-c1fbccdc1401 admin admin] Resource SecurityGroupRule deleted: bf216425-cb0c-4820-8c7c-d587908d4663 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:06.683485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4235a3d3-3449-42cd-a821-c1fbccdc1401 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (bf216425-cb0c-4820-8c7c-d587908d4663), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:06.684027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-4235a3d3-3449-42cd-a821-c1fbccdc1401 admin admin] Security group rule updated ['e1b9c040-9c9b-4bed-8f7d-942a2f55c696'] Sep 25 00:56:07.058945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ad217cbb-6445-4d5f-b54d-31c1207a741f None None] Resource Port a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:07.059310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ad217cbb-6445-4d5f-b54d-31c1207a741f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:07.114524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-81275f59-8e32-4ca2-9580-57de01a706ff tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Resource Port 3be19e53-1051-400f-988a-21c11c99e045 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'b53d51e2-ef91-4399-a2cd-bcea86331354'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:07.115318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-81275f59-8e32-4ca2-9580-57de01a706ff tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (3be19e53-1051-400f-988a-21c11c99e045), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:07.255301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["21571eb0-a6f4-442e-992d-14305209bbe6","insert","qr-a66f06df-0c",["set",[]],["map",[["attached-mac","fa:16:3e:ce:99:32"],["iface-id","a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:56:07.270793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["21571eb0-a6f4-442e-992d-14305209bbe6","old",null,["set",[]],null],["","new","qr-a66f06df-0c",16,["map",[["attached-mac","fa:16:3e:ce:99:32"],["iface-id","a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:56:07.360134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d0934286-f6d4-4289-b350-e63dbb65f933 None None] Resource Port a08ec5e3-6360-432b-aa85-85ce1774998d updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a08ec5e3-6360-432b-aa85-85ce1774998d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a08ec5e3-6360-432b-aa85-85ce1774998d,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=a08ec5e3-6360-432b-aa85-85ce1774998d,segment=NetworkSegment(60226fdd-ab84-4bff-9bed-5551adf26f89),segment_id=60226fdd-ab84-4bff-9bed-5551adf26f89)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:07.362026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d0934286-f6d4-4289-b350-e63dbb65f933 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (a08ec5e3-6360-432b-aa85-85ce1774998d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:08.334342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:259 started Sep 25 00:56:08.340947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834deb7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=64000000,duration_sec=531,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:08.342016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:56:08.342733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:259 - starting polling. Elapsed:0.009 Sep 25 00:56:08.345301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:08.358238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:259 - port information retrieved. Elapsed:0.024 Sep 25 00:56:08.358579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'b6b39056-a691-4ac9-a565-574d1c5a0cd5', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '1b8115fa-df9f-4b13-830a-866086f1b68f', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '68a3f405-e599-4339-b2a8-058311132e20', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', '7d521366-e68f-48bd-a7a8-e2283117a2b7', 'fc7bb1a7-9a53-42b3-8205-cc1649a623f2', 'a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'de4727a2-569d-44c6-a53e-ecc89817f610', '5204c0c3-4410-4695-a405-b599292c4e80'}, 'added': {'a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6'}, 'removed': set(), 'updated': {'a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:56:08.359161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': 'a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6', 'device_id': '1756485f-d872-4799-a254-ef11e7f98682', 'network_id': 'c3254d23-d48a-485d-a0e8-5f41e3baa079', 'port_id': 'a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6', 'mac_address': 'fa:16:3e:ce:99:32', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 96, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd4d50c9e-21e6-4b33-9f79-09c2d9887013', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:56:08.362237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:56:08.362576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6 updated. Details: {'device': 'a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6', 'device_id': '1756485f-d872-4799-a254-ef11e7f98682', 'network_id': 'c3254d23-d48a-485d-a0e8-5f41e3baa079', 'port_id': 'a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6', 'mac_address': 'fa:16:3e:ce:99:32', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 96, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd4d50c9e-21e6-4b33-9f79-09c2d9887013', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 5} Sep 25 00:56:08.377958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-a66f06df-0c, col_values=(('tag', 5),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:08.379901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-a66f06df-0c, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:08.381514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-a66f06df-0c, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:08.397796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-a66f06df-0c, col_values=(('other_config', {'net_uuid': 'c3254d23-d48a-485d-a0e8-5f41e3baa079', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '5', 'segmentation_id': '96'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:08.437605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834deb9,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 16}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:08.437963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:259 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 15 devices currently available. Time elapsed: 0.079 Sep 25 00:56:08.441205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing device filters for 1 new devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 25 00:56:08.442468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing filters for devices {'a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6'} Sep 25 00:56:08.446854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:56:08.447168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:56:08.471343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:56:08.595119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[468cd1e4-b2bf-4dff-8a92-624813ab104f]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:56:08.596209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:259 - agent port security group processed in 0.237 Sep 25 00:56:08.597383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:56:09.559389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d74f115f-467f-4600-bd86-6baeae362863 None None] Resource Port 1b8115fa-df9f-4b13-830a-866086f1b68f updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=1b8115fa-df9f-4b13-830a-866086f1b68f,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=1b8115fa-df9f-4b13-830a-866086f1b68f,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:09.561313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d74f115f-467f-4600-bd86-6baeae362863 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (1b8115fa-df9f-4b13-830a-866086f1b68f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:10.069863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["1d4ef316-765c-4509-b537-8c0d85c448b2","insert","qr-a08ec5e3-63",["set",[]],["map",[["attached-mac","fa:16:3e:a4:6c:86"],["iface-id","a08ec5e3-6360-432b-aa85-85ce1774998d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:56:10.101380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["1d4ef316-765c-4509-b537-8c0d85c448b2","old",null,["set",[]],null],["","new","qr-a08ec5e3-63",17,["map",[["attached-mac","fa:16:3e:a4:6c:86"],["iface-id","a08ec5e3-6360-432b-aa85-85ce1774998d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:56:10.140360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ad217cbb-6445-4d5f-b54d-31c1207a741f None None] Resource Port a08ec5e3-6360-432b-aa85-85ce1774998d updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:10.142736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ad217cbb-6445-4d5f-b54d-31c1207a741f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (a08ec5e3-6360-432b-aa85-85ce1774998d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:10.616885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6'] and devices down [] completed. Sep 25 00:56:10.619005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:259 - ports processed. Elapsed:2.285 Sep 25 00:56:10.619645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:259 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:2.285 Sep 25 00:56:10.620733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Loop iteration exceeded interval (2 vs. 2.2853357791900635)! {{(pid=107261) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Sep 25 00:56:10.621166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:260 started Sep 25 00:56:10.624131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834debb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=350000000,duration_sec=533,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:10.624872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:56:10.625804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:260 - starting polling. Elapsed:0.004 Sep 25 00:56:10.628854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:10.646708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:260 - port information retrieved. Elapsed:0.025 Sep 25 00:56:10.650115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'b6b39056-a691-4ac9-a565-574d1c5a0cd5', 'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '1b8115fa-df9f-4b13-830a-866086f1b68f', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '68a3f405-e599-4339-b2a8-058311132e20', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', '7d521366-e68f-48bd-a7a8-e2283117a2b7', 'fc7bb1a7-9a53-42b3-8205-cc1649a623f2', 'a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'de4727a2-569d-44c6-a53e-ecc89817f610', '5204c0c3-4410-4695-a405-b599292c4e80'}, 'added': {'a08ec5e3-6360-432b-aa85-85ce1774998d'}, 'removed': set(), 'updated': {'a08ec5e3-6360-432b-aa85-85ce1774998d', '1b8115fa-df9f-4b13-830a-866086f1b68f'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:56:10.654129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': 'a08ec5e3-6360-432b-aa85-85ce1774998d', 'device_id': '65efe4c7-23fe-404a-935b-071fd874df87', 'network_id': '334cdfa6-14bd-4f9b-b93c-dbd866cdb6bb', 'port_id': 'a08ec5e3-6360-432b-aa85-85ce1774998d', 'mac_address': 'fa:16:3e:a4:6c:86', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 87, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'cf3d0ae1-4d69-474f-b9d5-17c189ebf5ae', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:56:10.654956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: WARNING neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:55:53Z,data_plane_status=None,description='',device_id='0366ab62-209a-4a0a-a198-da6587ec3f4a',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=1b8115fa-df9f-4b13-830a-866086f1b68f,mac_address=fa:16:3e:04:63:4a,name='',network_id=e04e78f2-fc42-4b3e-9ba5-62cef58448f8,numa_affinity_policy=,project_id='28568584195d475fbc52d76185e09044',qos_network_policy_id=None,qos_policy_id=None,revision_number=3,security=PortSecurity(1b8115fa-df9f-4b13-830a-866086f1b68f),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:56:08Z) is not bound. Sep 25 00:56:10.660134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: a08ec5e3-6360-432b-aa85-85ce1774998d {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:56:10.674596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port a08ec5e3-6360-432b-aa85-85ce1774998d updated. Details: {'device': 'a08ec5e3-6360-432b-aa85-85ce1774998d', 'device_id': '65efe4c7-23fe-404a-935b-071fd874df87', 'network_id': '334cdfa6-14bd-4f9b-b93c-dbd866cdb6bb', 'port_id': 'a08ec5e3-6360-432b-aa85-85ce1774998d', 'mac_address': 'fa:16:3e:a4:6c:86', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 87, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'cf3d0ae1-4d69-474f-b9d5-17c189ebf5ae', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 6} Sep 25 00:56:10.677346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-a08ec5e3-63, col_values=(('tag', 6),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:10.677986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-a08ec5e3-63, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:10.678603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-a08ec5e3-63, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:10.704496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-a08ec5e3-63, col_values=(('other_config', {'net_uuid': '334cdfa6-14bd-4f9b-b93c-dbd866cdb6bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '6', 'segmentation_id': '87'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:10.743586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834debd,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 17}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:10.743947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 1b8115fa-df9f-4b13-830a-866086f1b68f {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:56:10.744240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Device 1b8115fa-df9f-4b13-830a-866086f1b68f not defined on plugin or binding failed Sep 25 00:56:10.744804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:260 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 16 devices currently available. Time elapsed: 0.091 Sep 25 00:56:10.745145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing device filters for 1 new devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 25 00:56:10.745471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing filters for devices {'a08ec5e3-6360-432b-aa85-85ce1774998d'} Sep 25 00:56:10.746626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:56:10.757345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:56:10.763193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:56:10.967883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[da759ec4-da53-45ff-8a1d-4f00457b3afc]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:56:10.968760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refreshing firewall for 1 devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 25 00:56:10.969203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refresh firewall rules Sep 25 00:56:10.970339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:56:10.970767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:56:10.974753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:260 - agent port security group processed in 0.321 Sep 25 00:56:10.975608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for a08ec5e3-6360-432b-aa85-85ce1774998d to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:56:12.576364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ef1f5f85-0586-412a-bb06-453f68e37b84 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:10Z,description='Default security group',id=4b98f20e-a379-4b7e-ab5f-c799b7b8a586,is_default=True,name='default',project_id='5ebd27a1c5574f37b514600466d568e2',revision_number=1,rules=[SecurityGroupRule(2d880c85-dede-45b1-992c-ca5078a15971),SecurityGroupRule(93189eec-8e5d-4c85-af6f-ffac27f63494),SecurityGroupRule(d7a75cd8-42b4-461d-8a22-ca6f22ebc127),SecurityGroupRule(f1006a34-f2f2-41d9-8c37-3d757bb6066d)],shared=False,stateful=True,updated_at=2022-09-25T00:56:10Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:12.577627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ef1f5f85-0586-412a-bb06-453f68e37b84 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (4b98f20e-a379-4b7e-ab5f-c799b7b8a586), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:12.578537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ef1f5f85-0586-412a-bb06-453f68e37b84 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:10Z,description=,direction='egress',ethertype='IPv6',id=2d880c85-dede-45b1-992c-ca5078a15971,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5ebd27a1c5574f37b514600466d568e2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4b98f20e-a379-4b7e-ab5f-c799b7b8a586,updated_at=2022-09-25T00:56:10Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:12.579133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ef1f5f85-0586-412a-bb06-453f68e37b84 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (2d880c85-dede-45b1-992c-ca5078a15971), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:12.579806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ef1f5f85-0586-412a-bb06-453f68e37b84 admin admin] Security group rule updated ['4b98f20e-a379-4b7e-ab5f-c799b7b8a586'] Sep 25 00:56:12.580643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ef1f5f85-0586-412a-bb06-453f68e37b84 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:10Z,description=,direction='ingress',ethertype='IPv6',id=93189eec-8e5d-4c85-af6f-ffac27f63494,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5ebd27a1c5574f37b514600466d568e2',protocol=,remote_address_group_id=,remote_group_id=4b98f20e-a379-4b7e-ab5f-c799b7b8a586,remote_ip_prefix=,revision_number=0,security_group_id=4b98f20e-a379-4b7e-ab5f-c799b7b8a586,updated_at=2022-09-25T00:56:10Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:12.582528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ef1f5f85-0586-412a-bb06-453f68e37b84 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (93189eec-8e5d-4c85-af6f-ffac27f63494), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:12.583376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ef1f5f85-0586-412a-bb06-453f68e37b84 admin admin] Security group rule updated ['4b98f20e-a379-4b7e-ab5f-c799b7b8a586'] Sep 25 00:56:12.588576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ef1f5f85-0586-412a-bb06-453f68e37b84 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:10Z,description=,direction='egress',ethertype='IPv4',id=d7a75cd8-42b4-461d-8a22-ca6f22ebc127,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5ebd27a1c5574f37b514600466d568e2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4b98f20e-a379-4b7e-ab5f-c799b7b8a586,updated_at=2022-09-25T00:56:10Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:12.592771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ef1f5f85-0586-412a-bb06-453f68e37b84 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (d7a75cd8-42b4-461d-8a22-ca6f22ebc127), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:12.593821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ef1f5f85-0586-412a-bb06-453f68e37b84 admin admin] Security group rule updated ['4b98f20e-a379-4b7e-ab5f-c799b7b8a586'] Sep 25 00:56:12.600276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ef1f5f85-0586-412a-bb06-453f68e37b84 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:10Z,description=,direction='ingress',ethertype='IPv4',id=f1006a34-f2f2-41d9-8c37-3d757bb6066d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5ebd27a1c5574f37b514600466d568e2',protocol=,remote_address_group_id=,remote_group_id=4b98f20e-a379-4b7e-ab5f-c799b7b8a586,remote_ip_prefix=,revision_number=0,security_group_id=4b98f20e-a379-4b7e-ab5f-c799b7b8a586,updated_at=2022-09-25T00:56:10Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:12.605114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ef1f5f85-0586-412a-bb06-453f68e37b84 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f1006a34-f2f2-41d9-8c37-3d757bb6066d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:12.605708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ef1f5f85-0586-412a-bb06-453f68e37b84 admin admin] Security group rule updated ['4b98f20e-a379-4b7e-ab5f-c799b7b8a586'] Sep 25 00:56:12.690747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d74f115f-467f-4600-bd86-6baeae362863 None None] Resource Port 1b8115fa-df9f-4b13-830a-866086f1b68f updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=1b8115fa-df9f-4b13-830a-866086f1b68f,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=1b8115fa-df9f-4b13-830a-866086f1b68f,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=1b8115fa-df9f-4b13-830a-866086f1b68f,segment=NetworkSegment(6dee2139-73a3-4d84-b994-05c9c1e85f42),segment_id=6dee2139-73a3-4d84-b994-05c9c1e85f42)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:12.691148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d74f115f-467f-4600-bd86-6baeae362863 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (1b8115fa-df9f-4b13-830a-866086f1b68f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:12.977560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fd22aa3c-ba66-4bd6-af35-2add444a3eb9 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:56:08Z,data_plane_status=None,description='',device_id='af139b53-2db6-43ea-9e69-27dfbb9304bc',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=0b0017e5-0afb-4334-8450-1d4303b0d473,mac_address=fa:16:3e:82:b2:5e,name='',network_id=5dc49b54-686c-4619-ad4c-65c72c26fd31,numa_affinity_policy=,project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(0b0017e5-0afb-4334-8450-1d4303b0d473),security_group_ids=set([85a4d961-6b69-4634-b71f-daffd4a3d47f]),status='DOWN',updated_at=2022-09-25T00:56:09Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:12.978176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fd22aa3c-ba66-4bd6-af35-2add444a3eb9 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (0b0017e5-0afb-4334-8450-1d4303b0d473), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:12.978944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-fd22aa3c-ba66-4bd6-af35-2add444a3eb9 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group member updated {'85a4d961-6b69-4634-b71f-daffd4a3d47f'} Sep 25 00:56:13.561189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['a08ec5e3-6360-432b-aa85-85ce1774998d'] and devices down [] completed. Sep 25 00:56:13.561533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:260 - ports processed. Elapsed:2.940 Sep 25 00:56:13.561875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:260 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 2, 'removed': 0}}. Elapsed:2.941 Sep 25 00:56:13.562640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Loop iteration exceeded interval (2 vs. 2.9406893253326416)! {{(pid=107261) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Sep 25 00:56:13.562941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:261 started Sep 25 00:56:13.566057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834debf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=291000000,duration_sec=536,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:13.566670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:56:13.567018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:261 - starting polling. Elapsed:0.004 Sep 25 00:56:13.575691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:13.582723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:261 - port information retrieved. Elapsed:0.020 Sep 25 00:56:13.583431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '68a3f405-e599-4339-b2a8-058311132e20', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', '7d521366-e68f-48bd-a7a8-e2283117a2b7', 'fc7bb1a7-9a53-42b3-8205-cc1649a623f2', 'a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6', '5204c0c3-4410-4695-a405-b599292c4e80', 'b6b39056-a691-4ac9-a565-574d1c5a0cd5', '1b8115fa-df9f-4b13-830a-866086f1b68f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'de4727a2-569d-44c6-a53e-ecc89817f610'}, 'added': set(), 'removed': set(), 'updated': {'1b8115fa-df9f-4b13-830a-866086f1b68f'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:56:13.587509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '1b8115fa-df9f-4b13-830a-866086f1b68f', 'device_id': '0366ab62-209a-4a0a-a198-da6587ec3f4a', 'network_id': 'e04e78f2-fc42-4b3e-9ba5-62cef58448f8', 'port_id': '1b8115fa-df9f-4b13-830a-866086f1b68f', 'mac_address': 'fa:16:3e:04:63:4a', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 54, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6474d219-e5a1-4a6c-8e41-4afa0ca3d765', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:56:13.597548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 1b8115fa-df9f-4b13-830a-866086f1b68f {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:56:13.597897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 1b8115fa-df9f-4b13-830a-866086f1b68f updated. Details: {'device': '1b8115fa-df9f-4b13-830a-866086f1b68f', 'device_id': '0366ab62-209a-4a0a-a198-da6587ec3f4a', 'network_id': 'e04e78f2-fc42-4b3e-9ba5-62cef58448f8', 'port_id': '1b8115fa-df9f-4b13-830a-866086f1b68f', 'mac_address': 'fa:16:3e:04:63:4a', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 54, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6474d219-e5a1-4a6c-8e41-4afa0ca3d765', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 7} Sep 25 00:56:13.602793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-1b8115fa-df, col_values=(('tag', 7),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:13.603271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-1b8115fa-df, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:13.604728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-1b8115fa-df, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:13.619713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-1b8115fa-df, col_values=(('other_config', {'net_uuid': 'e04e78f2-fc42-4b3e-9ba5-62cef58448f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '7', 'segmentation_id': '54'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:13.641148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834dec1,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 13}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:13.641856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:261 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 16 devices currently available. Time elapsed: 0.058 Sep 25 00:56:13.643299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refreshing firewall for 1 devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 25 00:56:13.645145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refresh firewall rules Sep 25 00:56:13.650153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:56:13.651050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:56:13.664813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:56:13.817611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[492b3b90-da4d-44f1-8043-50ac8f7ddac8]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:56:13.821904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:261 - agent port security group processed in 0.238 Sep 25 00:56:13.822925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 1b8115fa-df9f-4b13-830a-866086f1b68f to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:56:13.939948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8cdafefe-c826-493d-86b0-b6457e32c9e7 tempest-DeleteServersTestJSON-1998596361 tempest-DeleteServersTestJSON-1998596361-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:56:12Z,data_plane_status=None,description='',device_id='38e80e8e-ef14-4a77-b697-0d889f6cfa5f',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=9618d105-fdf7-4a07-9a29-e94ba03b6c41,mac_address=fa:16:3e:9b:a4:e5,name='',network_id=c3254d23-d48a-485d-a0e8-5f41e3baa079,numa_affinity_policy=,project_id='5ca92ea462d24d2d8632e5c52a3dfe63',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(9618d105-fdf7-4a07-9a29-e94ba03b6c41),security_group_ids=set([33e8b406-0d9d-4791-be58-7ab180367bdc]),status='DOWN',updated_at=2022-09-25T00:56:13Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:13.941179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8cdafefe-c826-493d-86b0-b6457e32c9e7 tempest-DeleteServersTestJSON-1998596361 tempest-DeleteServersTestJSON-1998596361-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (9618d105-fdf7-4a07-9a29-e94ba03b6c41), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:13.943268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8cdafefe-c826-493d-86b0-b6457e32c9e7 tempest-DeleteServersTestJSON-1998596361 tempest-DeleteServersTestJSON-1998596361-project] Security group member updated {'33e8b406-0d9d-4791-be58-7ab180367bdc'} Sep 25 00:56:14.275572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ad217cbb-6445-4d5f-b54d-31c1207a741f None None] Resource Port 1b8115fa-df9f-4b13-830a-866086f1b68f updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:14.276511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ad217cbb-6445-4d5f-b54d-31c1207a741f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (1b8115fa-df9f-4b13-830a-866086f1b68f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:14.307566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c7ed0cef-95dd-4463-a110-2dfb502028a2 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:12Z,description='Default security group',id=4f3cbfce-7787-4c5f-ad6e-593f9eeb1234,is_default=True,name='default',project_id='122985cea56d4df18d25bf3e04482c9a',revision_number=1,rules=[SecurityGroupRule(01248d4d-94f4-461a-87a4-027461e3fa0a),SecurityGroupRule(7a08c2e2-cf79-45e1-8a5a-9813cebdf8e9),SecurityGroupRule(8ccd7d17-963c-47c2-a382-edbc58ea2ef6),SecurityGroupRule(9a8081fa-e211-44b1-93c8-4e9637e91ed7)],shared=False,stateful=True,updated_at=2022-09-25T00:56:12Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:14.308140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c7ed0cef-95dd-4463-a110-2dfb502028a2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (4f3cbfce-7787-4c5f-ad6e-593f9eeb1234), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:14.308791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c7ed0cef-95dd-4463-a110-2dfb502028a2 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:12Z,description=,direction='ingress',ethertype='IPv4',id=01248d4d-94f4-461a-87a4-027461e3fa0a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='122985cea56d4df18d25bf3e04482c9a',protocol=,remote_address_group_id=,remote_group_id=4f3cbfce-7787-4c5f-ad6e-593f9eeb1234,remote_ip_prefix=,revision_number=0,security_group_id=4f3cbfce-7787-4c5f-ad6e-593f9eeb1234,updated_at=2022-09-25T00:56:12Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:14.310260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c7ed0cef-95dd-4463-a110-2dfb502028a2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (01248d4d-94f4-461a-87a4-027461e3fa0a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:14.310609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c7ed0cef-95dd-4463-a110-2dfb502028a2 admin admin] Security group rule updated ['4f3cbfce-7787-4c5f-ad6e-593f9eeb1234'] Sep 25 00:56:14.311541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c7ed0cef-95dd-4463-a110-2dfb502028a2 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:13Z,description=,direction='egress',ethertype='IPv4',id=7a08c2e2-cf79-45e1-8a5a-9813cebdf8e9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='122985cea56d4df18d25bf3e04482c9a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4f3cbfce-7787-4c5f-ad6e-593f9eeb1234,updated_at=2022-09-25T00:56:13Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:14.311658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c7ed0cef-95dd-4463-a110-2dfb502028a2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (7a08c2e2-cf79-45e1-8a5a-9813cebdf8e9), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:14.317760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c7ed0cef-95dd-4463-a110-2dfb502028a2 admin admin] Security group rule updated ['4f3cbfce-7787-4c5f-ad6e-593f9eeb1234'] Sep 25 00:56:14.319639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c7ed0cef-95dd-4463-a110-2dfb502028a2 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:13Z,description=,direction='ingress',ethertype='IPv6',id=8ccd7d17-963c-47c2-a382-edbc58ea2ef6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='122985cea56d4df18d25bf3e04482c9a',protocol=,remote_address_group_id=,remote_group_id=4f3cbfce-7787-4c5f-ad6e-593f9eeb1234,remote_ip_prefix=,revision_number=0,security_group_id=4f3cbfce-7787-4c5f-ad6e-593f9eeb1234,updated_at=2022-09-25T00:56:13Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:14.321877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c7ed0cef-95dd-4463-a110-2dfb502028a2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (8ccd7d17-963c-47c2-a382-edbc58ea2ef6), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:14.327588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c7ed0cef-95dd-4463-a110-2dfb502028a2 admin admin] Security group rule updated ['4f3cbfce-7787-4c5f-ad6e-593f9eeb1234'] Sep 25 00:56:14.328571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c7ed0cef-95dd-4463-a110-2dfb502028a2 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:13Z,description=,direction='egress',ethertype='IPv6',id=9a8081fa-e211-44b1-93c8-4e9637e91ed7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='122985cea56d4df18d25bf3e04482c9a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4f3cbfce-7787-4c5f-ad6e-593f9eeb1234,updated_at=2022-09-25T00:56:13Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:14.329650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c7ed0cef-95dd-4463-a110-2dfb502028a2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (9a8081fa-e211-44b1-93c8-4e9637e91ed7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:14.334596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c7ed0cef-95dd-4463-a110-2dfb502028a2 admin admin] Security group rule updated ['4f3cbfce-7787-4c5f-ad6e-593f9eeb1234'] Sep 25 00:56:14.357087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['1b8115fa-df9f-4b13-830a-866086f1b68f'] and devices down [] completed. Sep 25 00:56:14.357545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:261 - ports processed. Elapsed:0.794 Sep 25 00:56:14.358477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:261 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.795 Sep 25 00:56:14.765433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5bd58fe4-1e08-4e66-80c7-b8a737ec2134 admin admin] Resource SecurityGroup deleted: 4b98f20e-a379-4b7e-ab5f-c799b7b8a586 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:14.766050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5bd58fe4-1e08-4e66-80c7-b8a737ec2134 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (4b98f20e-a379-4b7e-ab5f-c799b7b8a586), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:14.767195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bd58fe4-1e08-4e66-80c7-b8a737ec2134 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('4b98f20e-a379-4b7e-ab5f-c799b7b8a586',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:56:14.948002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5bd58fe4-1e08-4e66-80c7-b8a737ec2134 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('4b98f20e-a379-4b7e-ab5f-c799b7b8a586',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:56:14.949231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5bd58fe4-1e08-4e66-80c7-b8a737ec2134 admin admin] Resource SecurityGroupRule deleted: 2d880c85-dede-45b1-992c-ca5078a15971 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:14.949651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5bd58fe4-1e08-4e66-80c7-b8a737ec2134 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (2d880c85-dede-45b1-992c-ca5078a15971), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:14.950000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5bd58fe4-1e08-4e66-80c7-b8a737ec2134 admin admin] Security group rule updated ['4b98f20e-a379-4b7e-ab5f-c799b7b8a586'] Sep 25 00:56:14.950490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5bd58fe4-1e08-4e66-80c7-b8a737ec2134 admin admin] Resource SecurityGroupRule deleted: 93189eec-8e5d-4c85-af6f-ffac27f63494 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:14.950850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5bd58fe4-1e08-4e66-80c7-b8a737ec2134 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (93189eec-8e5d-4c85-af6f-ffac27f63494), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:14.951265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5bd58fe4-1e08-4e66-80c7-b8a737ec2134 admin admin] Security group rule updated ['4b98f20e-a379-4b7e-ab5f-c799b7b8a586'] Sep 25 00:56:14.951667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5bd58fe4-1e08-4e66-80c7-b8a737ec2134 admin admin] Resource SecurityGroupRule deleted: d7a75cd8-42b4-461d-8a22-ca6f22ebc127 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:14.952568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5bd58fe4-1e08-4e66-80c7-b8a737ec2134 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (d7a75cd8-42b4-461d-8a22-ca6f22ebc127), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:14.953382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5bd58fe4-1e08-4e66-80c7-b8a737ec2134 admin admin] Security group rule updated ['4b98f20e-a379-4b7e-ab5f-c799b7b8a586'] Sep 25 00:56:14.954125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5bd58fe4-1e08-4e66-80c7-b8a737ec2134 admin admin] Resource SecurityGroupRule deleted: f1006a34-f2f2-41d9-8c37-3d757bb6066d {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:14.954832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5bd58fe4-1e08-4e66-80c7-b8a737ec2134 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f1006a34-f2f2-41d9-8c37-3d757bb6066d), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:14.956250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5bd58fe4-1e08-4e66-80c7-b8a737ec2134 admin admin] Security group rule updated ['4b98f20e-a379-4b7e-ab5f-c799b7b8a586'] Sep 25 00:56:15.443878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d5fae6a4-39c7-4835-a42c-f368255ce22b admin admin] Resource SecurityGroup deleted: 4f3cbfce-7787-4c5f-ad6e-593f9eeb1234 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:15.469656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d5fae6a4-39c7-4835-a42c-f368255ce22b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (4f3cbfce-7787-4c5f-ad6e-593f9eeb1234), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:15.470510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5fae6a4-39c7-4835-a42c-f368255ce22b admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('4f3cbfce-7787-4c5f-ad6e-593f9eeb1234',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:56:15.530423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d5fae6a4-39c7-4835-a42c-f368255ce22b admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('4f3cbfce-7787-4c5f-ad6e-593f9eeb1234',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:56:15.531079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d5fae6a4-39c7-4835-a42c-f368255ce22b admin admin] Resource SecurityGroupRule deleted: 01248d4d-94f4-461a-87a4-027461e3fa0a {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:15.531815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d5fae6a4-39c7-4835-a42c-f368255ce22b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (01248d4d-94f4-461a-87a4-027461e3fa0a), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:15.533372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d5fae6a4-39c7-4835-a42c-f368255ce22b admin admin] Security group rule updated ['4f3cbfce-7787-4c5f-ad6e-593f9eeb1234'] Sep 25 00:56:15.534303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d5fae6a4-39c7-4835-a42c-f368255ce22b admin admin] Resource SecurityGroupRule deleted: 7a08c2e2-cf79-45e1-8a5a-9813cebdf8e9 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:15.534877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d5fae6a4-39c7-4835-a42c-f368255ce22b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (7a08c2e2-cf79-45e1-8a5a-9813cebdf8e9), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:15.535474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d5fae6a4-39c7-4835-a42c-f368255ce22b admin admin] Security group rule updated ['4f3cbfce-7787-4c5f-ad6e-593f9eeb1234'] Sep 25 00:56:15.536404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d5fae6a4-39c7-4835-a42c-f368255ce22b admin admin] Resource SecurityGroupRule deleted: 8ccd7d17-963c-47c2-a382-edbc58ea2ef6 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:15.537179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d5fae6a4-39c7-4835-a42c-f368255ce22b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (8ccd7d17-963c-47c2-a382-edbc58ea2ef6), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:15.537746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d5fae6a4-39c7-4835-a42c-f368255ce22b admin admin] Security group rule updated ['4f3cbfce-7787-4c5f-ad6e-593f9eeb1234'] Sep 25 00:56:15.538654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d5fae6a4-39c7-4835-a42c-f368255ce22b admin admin] Resource SecurityGroupRule deleted: 9a8081fa-e211-44b1-93c8-4e9637e91ed7 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:15.540242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d5fae6a4-39c7-4835-a42c-f368255ce22b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (9a8081fa-e211-44b1-93c8-4e9637e91ed7), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:15.540818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d5fae6a4-39c7-4835-a42c-f368255ce22b admin admin] Security group rule updated ['4f3cbfce-7787-4c5f-ad6e-593f9eeb1234'] Sep 25 00:56:15.564783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:262 started Sep 25 00:56:15.568380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dec3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=293000000,duration_sec=538,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:15.569097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:56:15.569568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:262 - starting polling. Elapsed:0.005 Sep 25 00:56:15.572661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:15.582589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:262 - port information retrieved. Elapsed:0.015 Sep 25 00:56:15.593386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '68a3f405-e599-4339-b2a8-058311132e20', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', '7d521366-e68f-48bd-a7a8-e2283117a2b7', 'fc7bb1a7-9a53-42b3-8205-cc1649a623f2', 'a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6', '5204c0c3-4410-4695-a405-b599292c4e80', 'b6b39056-a691-4ac9-a565-574d1c5a0cd5', '1b8115fa-df9f-4b13-830a-866086f1b68f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'de4727a2-569d-44c6-a53e-ecc89817f610'}, 'added': set(), 'removed': set(), 'updated': {'1b8115fa-df9f-4b13-830a-866086f1b68f'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:56:15.593572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '1b8115fa-df9f-4b13-830a-866086f1b68f', 'device_id': '0366ab62-209a-4a0a-a198-da6587ec3f4a', 'network_id': 'e04e78f2-fc42-4b3e-9ba5-62cef58448f8', 'port_id': '1b8115fa-df9f-4b13-830a-866086f1b68f', 'mac_address': 'fa:16:3e:04:63:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 54, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6474d219-e5a1-4a6c-8e41-4afa0ca3d765', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:56:15.601027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 1b8115fa-df9f-4b13-830a-866086f1b68f {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:56:15.603541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 1b8115fa-df9f-4b13-830a-866086f1b68f updated. Details: {'device': '1b8115fa-df9f-4b13-830a-866086f1b68f', 'device_id': '0366ab62-209a-4a0a-a198-da6587ec3f4a', 'network_id': 'e04e78f2-fc42-4b3e-9ba5-62cef58448f8', 'port_id': '1b8115fa-df9f-4b13-830a-866086f1b68f', 'mac_address': 'fa:16:3e:04:63:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 54, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6474d219-e5a1-4a6c-8e41-4afa0ca3d765', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 7} Sep 25 00:56:15.613606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-1b8115fa-df, col_values=(('tag', 7),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:15.616692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-1b8115fa-df, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:15.617534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-1b8115fa-df, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:15.618258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:56:15.620582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-1b8115fa-df, col_values=(('other_config', {'net_uuid': 'e04e78f2-fc42-4b3e-9ba5-62cef58448f8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '54', 'tag': '7'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:56:15.621594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:56:15.626241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834dec5,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 13}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:15.627847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:262 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 16 devices currently available. Time elapsed: 0.043 Sep 25 00:56:15.628351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refreshing firewall for 1 devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 25 00:56:15.628736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refresh firewall rules Sep 25 00:56:15.630710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:56:15.631204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:56:15.638138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:56:15.732488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76b7154-dad3-45c7-9cc8-a205ba9d8567]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:56:15.733927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:262 - agent port security group processed in 0.150 Sep 25 00:56:15.735037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 1b8115fa-df9f-4b13-830a-866086f1b68f to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:56:16.110036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['1b8115fa-df9f-4b13-830a-866086f1b68f'] and devices down [] completed. Sep 25 00:56:16.110752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:262 - ports processed. Elapsed:0.546 Sep 25 00:56:16.111387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:262 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.546 Sep 25 00:56:16.161790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ff7d5328-6bba-4e83-b5f8-899922828763 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:56:09Z,data_plane_status=None,description='',device_id='3c9017f3-8bdb-4c13-9c50-646241c8f1ba',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=1f1b4ee1-4f64-49a9-bb20-210b866dfbd5,mac_address=fa:16:3e:d9:1d:d1,name='',network_id=e04e78f2-fc42-4b3e-9ba5-62cef58448f8,numa_affinity_policy=,project_id='28568584195d475fbc52d76185e09044',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(1f1b4ee1-4f64-49a9-bb20-210b866dfbd5),security_group_ids=set([228a413f-3378-42d6-84fd-cf375d775113]),status='DOWN',updated_at=2022-09-25T00:56:12Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:16.162183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ff7d5328-6bba-4e83-b5f8-899922828763 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (1f1b4ee1-4f64-49a9-bb20-210b866dfbd5), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:16.162734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ff7d5328-6bba-4e83-b5f8-899922828763 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Security group member updated {'228a413f-3378-42d6-84fd-cf375d775113'} Sep 25 00:56:16.190896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d7ac7920-eeb9-4aba-b847-116f51289912 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:14Z,description='Default security group',id=67a0a6f8-8495-43bc-b0eb-8fd25b521770,is_default=True,name='default',project_id='55b9b458194a4f4084ea2186c20b1efd',revision_number=1,rules=[SecurityGroupRule(457aff0a-c8df-4842-873c-c3dbba9b7bc4),SecurityGroupRule(4d886254-044c-4094-bc77-7851d3da2c37),SecurityGroupRule(c6724245-015c-4252-a502-79cd9f113d92),SecurityGroupRule(d8436f9d-4639-4ce3-9e60-814d36e43af5)],shared=False,stateful=True,updated_at=2022-09-25T00:56:15Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:16.194587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d7ac7920-eeb9-4aba-b847-116f51289912 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (67a0a6f8-8495-43bc-b0eb-8fd25b521770), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:16.196291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d7ac7920-eeb9-4aba-b847-116f51289912 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:15Z,description=,direction='egress',ethertype='IPv6',id=457aff0a-c8df-4842-873c-c3dbba9b7bc4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='55b9b458194a4f4084ea2186c20b1efd',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=67a0a6f8-8495-43bc-b0eb-8fd25b521770,updated_at=2022-09-25T00:56:15Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:16.197576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d7ac7920-eeb9-4aba-b847-116f51289912 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (457aff0a-c8df-4842-873c-c3dbba9b7bc4), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:16.198249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d7ac7920-eeb9-4aba-b847-116f51289912 admin admin] Security group rule updated ['67a0a6f8-8495-43bc-b0eb-8fd25b521770'] Sep 25 00:56:16.199509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d7ac7920-eeb9-4aba-b847-116f51289912 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:15Z,description=,direction='ingress',ethertype='IPv4',id=4d886254-044c-4094-bc77-7851d3da2c37,normalized_cidr=None,port_range_max=,port_range_min=,project_id='55b9b458194a4f4084ea2186c20b1efd',protocol=,remote_address_group_id=,remote_group_id=67a0a6f8-8495-43bc-b0eb-8fd25b521770,remote_ip_prefix=,revision_number=0,security_group_id=67a0a6f8-8495-43bc-b0eb-8fd25b521770,updated_at=2022-09-25T00:56:15Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:16.200151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d7ac7920-eeb9-4aba-b847-116f51289912 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (4d886254-044c-4094-bc77-7851d3da2c37), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:16.200758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d7ac7920-eeb9-4aba-b847-116f51289912 admin admin] Security group rule updated ['67a0a6f8-8495-43bc-b0eb-8fd25b521770'] Sep 25 00:56:16.202740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d7ac7920-eeb9-4aba-b847-116f51289912 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:15Z,description=,direction='ingress',ethertype='IPv6',id=c6724245-015c-4252-a502-79cd9f113d92,normalized_cidr=None,port_range_max=,port_range_min=,project_id='55b9b458194a4f4084ea2186c20b1efd',protocol=,remote_address_group_id=,remote_group_id=67a0a6f8-8495-43bc-b0eb-8fd25b521770,remote_ip_prefix=,revision_number=0,security_group_id=67a0a6f8-8495-43bc-b0eb-8fd25b521770,updated_at=2022-09-25T00:56:15Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:16.203747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d7ac7920-eeb9-4aba-b847-116f51289912 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (c6724245-015c-4252-a502-79cd9f113d92), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:16.204723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d7ac7920-eeb9-4aba-b847-116f51289912 admin admin] Security group rule updated ['67a0a6f8-8495-43bc-b0eb-8fd25b521770'] Sep 25 00:56:16.205674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d7ac7920-eeb9-4aba-b847-116f51289912 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:15Z,description=,direction='egress',ethertype='IPv4',id=d8436f9d-4639-4ce3-9e60-814d36e43af5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='55b9b458194a4f4084ea2186c20b1efd',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=67a0a6f8-8495-43bc-b0eb-8fd25b521770,updated_at=2022-09-25T00:56:15Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:16.206186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d7ac7920-eeb9-4aba-b847-116f51289912 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (d8436f9d-4639-4ce3-9e60-814d36e43af5), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:16.207056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d7ac7920-eeb9-4aba-b847-116f51289912 admin admin] Security group rule updated ['67a0a6f8-8495-43bc-b0eb-8fd25b521770'] Sep 25 00:56:16.386128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-84bb92ea-103b-48bd-a5ae-2f0c0ac21b1f admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:15Z,description='Default security group',id=319977b9-66be-449a-ad68-3ee9c71fcd0a,is_default=True,name='default',project_id='b93a309e12d34f94b871601cc45e9255',revision_number=1,rules=[SecurityGroupRule(104a0e5a-8a37-4ae9-97c3-b3a74cbe2b34),SecurityGroupRule(45d24c57-2dcb-494d-a3f9-8a02f9b331a3),SecurityGroupRule(a62c3f26-4afc-4302-9c27-4ca63a53ec04),SecurityGroupRule(e47c5bd5-cd7b-4aae-9d76-fcf3d4d96988)],shared=False,stateful=True,updated_at=2022-09-25T00:56:15Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:16.386575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-84bb92ea-103b-48bd-a5ae-2f0c0ac21b1f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (319977b9-66be-449a-ad68-3ee9c71fcd0a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:16.389504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-84bb92ea-103b-48bd-a5ae-2f0c0ac21b1f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:15Z,description=,direction='ingress',ethertype='IPv6',id=104a0e5a-8a37-4ae9-97c3-b3a74cbe2b34,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b93a309e12d34f94b871601cc45e9255',protocol=,remote_address_group_id=,remote_group_id=319977b9-66be-449a-ad68-3ee9c71fcd0a,remote_ip_prefix=,revision_number=0,security_group_id=319977b9-66be-449a-ad68-3ee9c71fcd0a,updated_at=2022-09-25T00:56:15Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:16.390089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-84bb92ea-103b-48bd-a5ae-2f0c0ac21b1f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (104a0e5a-8a37-4ae9-97c3-b3a74cbe2b34), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:16.390639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-84bb92ea-103b-48bd-a5ae-2f0c0ac21b1f admin admin] Security group rule updated ['319977b9-66be-449a-ad68-3ee9c71fcd0a'] Sep 25 00:56:16.391516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-84bb92ea-103b-48bd-a5ae-2f0c0ac21b1f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:15Z,description=,direction='ingress',ethertype='IPv4',id=45d24c57-2dcb-494d-a3f9-8a02f9b331a3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b93a309e12d34f94b871601cc45e9255',protocol=,remote_address_group_id=,remote_group_id=319977b9-66be-449a-ad68-3ee9c71fcd0a,remote_ip_prefix=,revision_number=0,security_group_id=319977b9-66be-449a-ad68-3ee9c71fcd0a,updated_at=2022-09-25T00:56:15Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:16.391936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-84bb92ea-103b-48bd-a5ae-2f0c0ac21b1f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (45d24c57-2dcb-494d-a3f9-8a02f9b331a3), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:16.392326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-84bb92ea-103b-48bd-a5ae-2f0c0ac21b1f admin admin] Security group rule updated ['319977b9-66be-449a-ad68-3ee9c71fcd0a'] Sep 25 00:56:16.393194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-84bb92ea-103b-48bd-a5ae-2f0c0ac21b1f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:16Z,description=,direction='egress',ethertype='IPv6',id=a62c3f26-4afc-4302-9c27-4ca63a53ec04,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b93a309e12d34f94b871601cc45e9255',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=319977b9-66be-449a-ad68-3ee9c71fcd0a,updated_at=2022-09-25T00:56:16Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:16.393646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-84bb92ea-103b-48bd-a5ae-2f0c0ac21b1f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (a62c3f26-4afc-4302-9c27-4ca63a53ec04), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:16.394530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-84bb92ea-103b-48bd-a5ae-2f0c0ac21b1f admin admin] Security group rule updated ['319977b9-66be-449a-ad68-3ee9c71fcd0a'] Sep 25 00:56:16.395670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-84bb92ea-103b-48bd-a5ae-2f0c0ac21b1f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:15Z,description=,direction='egress',ethertype='IPv4',id=e47c5bd5-cd7b-4aae-9d76-fcf3d4d96988,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b93a309e12d34f94b871601cc45e9255',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=319977b9-66be-449a-ad68-3ee9c71fcd0a,updated_at=2022-09-25T00:56:15Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:16.396627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-84bb92ea-103b-48bd-a5ae-2f0c0ac21b1f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (e47c5bd5-cd7b-4aae-9d76-fcf3d4d96988), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:16.397083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-84bb92ea-103b-48bd-a5ae-2f0c0ac21b1f admin admin] Security group rule updated ['319977b9-66be-449a-ad68-3ee9c71fcd0a'] Sep 25 00:56:16.493618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2542925f-c329-4db8-a67c-deee2654caf3 service neutron] Resource Port 0b0017e5-0afb-4334-8450-1d4303b0d473 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=0b0017e5-0afb-4334-8450-1d4303b0d473,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=0b0017e5-0afb-4334-8450-1d4303b0d473,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:16.494055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2542925f-c329-4db8-a67c-deee2654caf3 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (0b0017e5-0afb-4334-8450-1d4303b0d473), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:16.589729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e4f8e830-0839-427e-9660-8e6067e8a57f admin admin] Resource SecurityGroup deleted: 67a0a6f8-8495-43bc-b0eb-8fd25b521770 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:16.590329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e4f8e830-0839-427e-9660-8e6067e8a57f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (67a0a6f8-8495-43bc-b0eb-8fd25b521770), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:16.591113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4f8e830-0839-427e-9660-8e6067e8a57f admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('67a0a6f8-8495-43bc-b0eb-8fd25b521770',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:56:16.615122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e4f8e830-0839-427e-9660-8e6067e8a57f admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('67a0a6f8-8495-43bc-b0eb-8fd25b521770',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:56:16.615877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e4f8e830-0839-427e-9660-8e6067e8a57f admin admin] Resource SecurityGroupRule deleted: 457aff0a-c8df-4842-873c-c3dbba9b7bc4 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:16.616418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e4f8e830-0839-427e-9660-8e6067e8a57f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (457aff0a-c8df-4842-873c-c3dbba9b7bc4), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:16.617114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-e4f8e830-0839-427e-9660-8e6067e8a57f admin admin] Security group rule updated ['67a0a6f8-8495-43bc-b0eb-8fd25b521770'] Sep 25 00:56:16.617878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e4f8e830-0839-427e-9660-8e6067e8a57f admin admin] Resource SecurityGroupRule deleted: 4d886254-044c-4094-bc77-7851d3da2c37 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:16.618472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e4f8e830-0839-427e-9660-8e6067e8a57f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (4d886254-044c-4094-bc77-7851d3da2c37), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:16.619166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-e4f8e830-0839-427e-9660-8e6067e8a57f admin admin] Security group rule updated ['67a0a6f8-8495-43bc-b0eb-8fd25b521770'] Sep 25 00:56:16.619695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e4f8e830-0839-427e-9660-8e6067e8a57f admin admin] Resource SecurityGroupRule deleted: c6724245-015c-4252-a502-79cd9f113d92 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:16.620298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e4f8e830-0839-427e-9660-8e6067e8a57f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (c6724245-015c-4252-a502-79cd9f113d92), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:16.620856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-e4f8e830-0839-427e-9660-8e6067e8a57f admin admin] Security group rule updated ['67a0a6f8-8495-43bc-b0eb-8fd25b521770'] Sep 25 00:56:16.621440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e4f8e830-0839-427e-9660-8e6067e8a57f admin admin] Resource SecurityGroupRule deleted: d8436f9d-4639-4ce3-9e60-814d36e43af5 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:16.621951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e4f8e830-0839-427e-9660-8e6067e8a57f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (d8436f9d-4639-4ce3-9e60-814d36e43af5), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:16.622438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-e4f8e830-0839-427e-9660-8e6067e8a57f admin admin] Security group rule updated ['67a0a6f8-8495-43bc-b0eb-8fd25b521770'] Sep 25 00:56:16.782362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8d7ef194-0658-4b38-9ed9-382b29906cc3 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:16Z,description='Default security group',id=bfc2d17c-7046-47e5-bf05-d80f20d05825,is_default=True,name='default',project_id='c549d8eee4e64e0196bb387d08150c6a',revision_number=1,rules=[SecurityGroupRule(064df8bf-86d1-4210-a300-58a57a6d9ed4),SecurityGroupRule(693417ff-8a7a-4afc-b41f-aa0e42f42236),SecurityGroupRule(78206cdf-57ea-42fe-85b8-0ae72859fe36),SecurityGroupRule(c61b1645-c337-4bdd-a8c4-6b6bc4c467cf)],shared=False,stateful=True,updated_at=2022-09-25T00:56:16Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:16.783583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8d7ef194-0658-4b38-9ed9-382b29906cc3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (bfc2d17c-7046-47e5-bf05-d80f20d05825), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:16.784252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8d7ef194-0658-4b38-9ed9-382b29906cc3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:16Z,description=,direction='egress',ethertype='IPv4',id=064df8bf-86d1-4210-a300-58a57a6d9ed4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c549d8eee4e64e0196bb387d08150c6a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=bfc2d17c-7046-47e5-bf05-d80f20d05825,updated_at=2022-09-25T00:56:16Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:16.784848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8d7ef194-0658-4b38-9ed9-382b29906cc3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (064df8bf-86d1-4210-a300-58a57a6d9ed4), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:16.785237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8d7ef194-0658-4b38-9ed9-382b29906cc3 admin admin] Security group rule updated ['bfc2d17c-7046-47e5-bf05-d80f20d05825'] Sep 25 00:56:16.786179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8d7ef194-0658-4b38-9ed9-382b29906cc3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:16Z,description=,direction='ingress',ethertype='IPv6',id=693417ff-8a7a-4afc-b41f-aa0e42f42236,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c549d8eee4e64e0196bb387d08150c6a',protocol=,remote_address_group_id=,remote_group_id=bfc2d17c-7046-47e5-bf05-d80f20d05825,remote_ip_prefix=,revision_number=0,security_group_id=bfc2d17c-7046-47e5-bf05-d80f20d05825,updated_at=2022-09-25T00:56:16Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:16.786553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8d7ef194-0658-4b38-9ed9-382b29906cc3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (693417ff-8a7a-4afc-b41f-aa0e42f42236), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:16.786896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8d7ef194-0658-4b38-9ed9-382b29906cc3 admin admin] Security group rule updated ['bfc2d17c-7046-47e5-bf05-d80f20d05825'] Sep 25 00:56:16.787711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8d7ef194-0658-4b38-9ed9-382b29906cc3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:16Z,description=,direction='ingress',ethertype='IPv4',id=78206cdf-57ea-42fe-85b8-0ae72859fe36,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c549d8eee4e64e0196bb387d08150c6a',protocol=,remote_address_group_id=,remote_group_id=bfc2d17c-7046-47e5-bf05-d80f20d05825,remote_ip_prefix=,revision_number=0,security_group_id=bfc2d17c-7046-47e5-bf05-d80f20d05825,updated_at=2022-09-25T00:56:16Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:16.790583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8d7ef194-0658-4b38-9ed9-382b29906cc3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (78206cdf-57ea-42fe-85b8-0ae72859fe36), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:16.791420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8d7ef194-0658-4b38-9ed9-382b29906cc3 admin admin] Security group rule updated ['bfc2d17c-7046-47e5-bf05-d80f20d05825'] Sep 25 00:56:16.792591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8d7ef194-0658-4b38-9ed9-382b29906cc3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:16Z,description=,direction='egress',ethertype='IPv6',id=c61b1645-c337-4bdd-a8c4-6b6bc4c467cf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c549d8eee4e64e0196bb387d08150c6a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=bfc2d17c-7046-47e5-bf05-d80f20d05825,updated_at=2022-09-25T00:56:16Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:16.794456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8d7ef194-0658-4b38-9ed9-382b29906cc3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (c61b1645-c337-4bdd-a8c4-6b6bc4c467cf), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:16.795163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8d7ef194-0658-4b38-9ed9-382b29906cc3 admin admin] Security group rule updated ['bfc2d17c-7046-47e5-bf05-d80f20d05825'] Sep 25 00:56:16.808057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-faabd6de-01f2-47c6-945f-34aaa42e3785 admin admin] Resource SecurityGroup deleted: 319977b9-66be-449a-ad68-3ee9c71fcd0a {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:16.808419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-faabd6de-01f2-47c6-945f-34aaa42e3785 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (319977b9-66be-449a-ad68-3ee9c71fcd0a), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:16.809105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-faabd6de-01f2-47c6-945f-34aaa42e3785 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('319977b9-66be-449a-ad68-3ee9c71fcd0a',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:56:16.836017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-faabd6de-01f2-47c6-945f-34aaa42e3785 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('319977b9-66be-449a-ad68-3ee9c71fcd0a',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:56:16.836692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-faabd6de-01f2-47c6-945f-34aaa42e3785 admin admin] Resource SecurityGroupRule deleted: 104a0e5a-8a37-4ae9-97c3-b3a74cbe2b34 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:16.837382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-faabd6de-01f2-47c6-945f-34aaa42e3785 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (104a0e5a-8a37-4ae9-97c3-b3a74cbe2b34), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:16.837765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-faabd6de-01f2-47c6-945f-34aaa42e3785 admin admin] Security group rule updated ['319977b9-66be-449a-ad68-3ee9c71fcd0a'] Sep 25 00:56:16.844464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-faabd6de-01f2-47c6-945f-34aaa42e3785 admin admin] Resource SecurityGroupRule deleted: 45d24c57-2dcb-494d-a3f9-8a02f9b331a3 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:16.845050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-faabd6de-01f2-47c6-945f-34aaa42e3785 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (45d24c57-2dcb-494d-a3f9-8a02f9b331a3), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:16.845602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-faabd6de-01f2-47c6-945f-34aaa42e3785 admin admin] Security group rule updated ['319977b9-66be-449a-ad68-3ee9c71fcd0a'] Sep 25 00:56:16.846915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-faabd6de-01f2-47c6-945f-34aaa42e3785 admin admin] Resource SecurityGroupRule deleted: a62c3f26-4afc-4302-9c27-4ca63a53ec04 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:16.847426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-faabd6de-01f2-47c6-945f-34aaa42e3785 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (a62c3f26-4afc-4302-9c27-4ca63a53ec04), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:16.847906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-faabd6de-01f2-47c6-945f-34aaa42e3785 admin admin] Security group rule updated ['319977b9-66be-449a-ad68-3ee9c71fcd0a'] Sep 25 00:56:16.848434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-faabd6de-01f2-47c6-945f-34aaa42e3785 admin admin] Resource SecurityGroupRule deleted: e47c5bd5-cd7b-4aae-9d76-fcf3d4d96988 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:16.849097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-faabd6de-01f2-47c6-945f-34aaa42e3785 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (e47c5bd5-cd7b-4aae-9d76-fcf3d4d96988), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:16.849749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-faabd6de-01f2-47c6-945f-34aaa42e3785 admin admin] Security group rule updated ['319977b9-66be-449a-ad68-3ee9c71fcd0a'] Sep 25 00:56:17.019819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9f01d6f0-6111-483f-98ca-67cc1d2d729c tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:56:11Z,data_plane_status=None,description='',device_id='67d7a7f9-a0d9-4f96-b9b2-569049374b4f',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=344eed51-ca03-4da0-b7a1-415ff8227472,mac_address=fa:16:3e:6c:5b:45,name='',network_id=e04e78f2-fc42-4b3e-9ba5-62cef58448f8,numa_affinity_policy=,project_id='28568584195d475fbc52d76185e09044',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(344eed51-ca03-4da0-b7a1-415ff8227472),security_group_ids=set([228a413f-3378-42d6-84fd-cf375d775113]),status='DOWN',updated_at=2022-09-25T00:56:16Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:17.020319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9f01d6f0-6111-483f-98ca-67cc1d2d729c tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (344eed51-ca03-4da0-b7a1-415ff8227472), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:17.021077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9f01d6f0-6111-483f-98ca-67cc1d2d729c tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Security group member updated {'228a413f-3378-42d6-84fd-cf375d775113'} Sep 25 00:56:17.030126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2542925f-c329-4db8-a67c-deee2654caf3 service neutron] Resource Port 0b0017e5-0afb-4334-8450-1d4303b0d473 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=0b0017e5-0afb-4334-8450-1d4303b0d473,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=0b0017e5-0afb-4334-8450-1d4303b0d473,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=0b0017e5-0afb-4334-8450-1d4303b0d473,segment=NetworkSegment(32553459-8243-41b9-9fc0-bae9f5646e9f),segment_id=32553459-8243-41b9-9fc0-bae9f5646e9f)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:17.043438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2542925f-c329-4db8-a67c-deee2654caf3 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (0b0017e5-0afb-4334-8450-1d4303b0d473), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:17.529023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-456d0180-79a4-43ab-b61e-3380a3e32314 admin admin] Resource SecurityGroup deleted: bfc2d17c-7046-47e5-bf05-d80f20d05825 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:17.529635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-456d0180-79a4-43ab-b61e-3380a3e32314 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (bfc2d17c-7046-47e5-bf05-d80f20d05825), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:17.530196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-456d0180-79a4-43ab-b61e-3380a3e32314 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('bfc2d17c-7046-47e5-bf05-d80f20d05825',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:56:17.566656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:263 started Sep 25 00:56:17.569570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-456d0180-79a4-43ab-b61e-3380a3e32314 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('bfc2d17c-7046-47e5-bf05-d80f20d05825',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:56:17.574088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-456d0180-79a4-43ab-b61e-3380a3e32314 admin admin] Resource SecurityGroupRule deleted: 064df8bf-86d1-4210-a300-58a57a6d9ed4 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:17.574517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-456d0180-79a4-43ab-b61e-3380a3e32314 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (064df8bf-86d1-4210-a300-58a57a6d9ed4), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:17.574869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-456d0180-79a4-43ab-b61e-3380a3e32314 admin admin] Security group rule updated ['bfc2d17c-7046-47e5-bf05-d80f20d05825'] Sep 25 00:56:17.575276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-456d0180-79a4-43ab-b61e-3380a3e32314 admin admin] Resource SecurityGroupRule deleted: 693417ff-8a7a-4afc-b41f-aa0e42f42236 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:17.575627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-456d0180-79a4-43ab-b61e-3380a3e32314 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (693417ff-8a7a-4afc-b41f-aa0e42f42236), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:17.575948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-456d0180-79a4-43ab-b61e-3380a3e32314 admin admin] Security group rule updated ['bfc2d17c-7046-47e5-bf05-d80f20d05825'] Sep 25 00:56:17.584139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-456d0180-79a4-43ab-b61e-3380a3e32314 admin admin] Resource SecurityGroupRule deleted: 78206cdf-57ea-42fe-85b8-0ae72859fe36 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:17.584519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-456d0180-79a4-43ab-b61e-3380a3e32314 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (78206cdf-57ea-42fe-85b8-0ae72859fe36), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:17.584854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-456d0180-79a4-43ab-b61e-3380a3e32314 admin admin] Security group rule updated ['bfc2d17c-7046-47e5-bf05-d80f20d05825'] Sep 25 00:56:17.586755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-456d0180-79a4-43ab-b61e-3380a3e32314 admin admin] Resource SecurityGroupRule deleted: c61b1645-c337-4bdd-a8c4-6b6bc4c467cf {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:17.587988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-456d0180-79a4-43ab-b61e-3380a3e32314 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (c61b1645-c337-4bdd-a8c4-6b6bc4c467cf), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:17.588495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-456d0180-79a4-43ab-b61e-3380a3e32314 admin admin] Security group rule updated ['bfc2d17c-7046-47e5-bf05-d80f20d05825'] Sep 25 00:56:17.593306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dec7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=318000000,duration_sec=540,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:17.598077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:56:17.599527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:263 - starting polling. Elapsed:0.033 Sep 25 00:56:17.605545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:17.612953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:263 - port information retrieved. Elapsed:0.046 Sep 25 00:56:17.615335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:263 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.049 Sep 25 00:56:17.702196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-90e11ad6-fb14-49e4-aace-d36752dec870 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:17Z,description='Default security group',id=f670c468-d418-4477-a93a-73600c309424,is_default=True,name='default',project_id='8928bfafbc184624805c19c6ecd97656',revision_number=1,rules=[SecurityGroupRule(172fa61c-36fa-4d50-823c-5f1089a6cb97),SecurityGroupRule(7b9c0750-e974-4e5e-89ac-0b3cd41147c2),SecurityGroupRule(ce4d8cd8-e154-4017-981f-373a4bb172fe),SecurityGroupRule(f545bc5a-1d0c-444c-9331-9a2a0c8e2932)],shared=False,stateful=True,updated_at=2022-09-25T00:56:17Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:17.702691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-90e11ad6-fb14-49e4-aace-d36752dec870 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (f670c468-d418-4477-a93a-73600c309424), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:17.703443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-90e11ad6-fb14-49e4-aace-d36752dec870 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:17Z,description=,direction='ingress',ethertype='IPv6',id=172fa61c-36fa-4d50-823c-5f1089a6cb97,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8928bfafbc184624805c19c6ecd97656',protocol=,remote_address_group_id=,remote_group_id=f670c468-d418-4477-a93a-73600c309424,remote_ip_prefix=,revision_number=0,security_group_id=f670c468-d418-4477-a93a-73600c309424,updated_at=2022-09-25T00:56:17Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:17.704874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-90e11ad6-fb14-49e4-aace-d36752dec870 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (172fa61c-36fa-4d50-823c-5f1089a6cb97), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:17.705677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-90e11ad6-fb14-49e4-aace-d36752dec870 admin admin] Security group rule updated ['f670c468-d418-4477-a93a-73600c309424'] Sep 25 00:56:17.706684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-90e11ad6-fb14-49e4-aace-d36752dec870 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:17Z,description=,direction='egress',ethertype='IPv4',id=7b9c0750-e974-4e5e-89ac-0b3cd41147c2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8928bfafbc184624805c19c6ecd97656',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f670c468-d418-4477-a93a-73600c309424,updated_at=2022-09-25T00:56:17Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:17.707197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-90e11ad6-fb14-49e4-aace-d36752dec870 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (7b9c0750-e974-4e5e-89ac-0b3cd41147c2), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:17.707696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-90e11ad6-fb14-49e4-aace-d36752dec870 admin admin] Security group rule updated ['f670c468-d418-4477-a93a-73600c309424'] Sep 25 00:56:17.709169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-90e11ad6-fb14-49e4-aace-d36752dec870 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:17Z,description=,direction='egress',ethertype='IPv6',id=ce4d8cd8-e154-4017-981f-373a4bb172fe,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8928bfafbc184624805c19c6ecd97656',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f670c468-d418-4477-a93a-73600c309424,updated_at=2022-09-25T00:56:17Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:17.709825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-90e11ad6-fb14-49e4-aace-d36752dec870 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (ce4d8cd8-e154-4017-981f-373a4bb172fe), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:17.711763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-90e11ad6-fb14-49e4-aace-d36752dec870 admin admin] Security group rule updated ['f670c468-d418-4477-a93a-73600c309424'] Sep 25 00:56:17.712863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-90e11ad6-fb14-49e4-aace-d36752dec870 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:17Z,description=,direction='ingress',ethertype='IPv4',id=f545bc5a-1d0c-444c-9331-9a2a0c8e2932,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8928bfafbc184624805c19c6ecd97656',protocol=,remote_address_group_id=,remote_group_id=f670c468-d418-4477-a93a-73600c309424,remote_ip_prefix=,revision_number=0,security_group_id=f670c468-d418-4477-a93a-73600c309424,updated_at=2022-09-25T00:56:17Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:17.716308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-90e11ad6-fb14-49e4-aace-d36752dec870 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f545bc5a-1d0c-444c-9331-9a2a0c8e2932), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:17.716855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-90e11ad6-fb14-49e4-aace-d36752dec870 admin admin] Security group rule updated ['f670c468-d418-4477-a93a-73600c309424'] Sep 25 00:56:17.936493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d49b3017-eae6-4fc1-895e-b40cf1e383f6 admin admin] Resource SecurityGroup deleted: f670c468-d418-4477-a93a-73600c309424 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:17.936901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d49b3017-eae6-4fc1-895e-b40cf1e383f6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (f670c468-d418-4477-a93a-73600c309424), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:17.937832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d49b3017-eae6-4fc1-895e-b40cf1e383f6 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('f670c468-d418-4477-a93a-73600c309424',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:56:17.952538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d49b3017-eae6-4fc1-895e-b40cf1e383f6 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('f670c468-d418-4477-a93a-73600c309424',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:56:17.953057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d49b3017-eae6-4fc1-895e-b40cf1e383f6 admin admin] Resource SecurityGroupRule deleted: 172fa61c-36fa-4d50-823c-5f1089a6cb97 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:17.953797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d49b3017-eae6-4fc1-895e-b40cf1e383f6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (172fa61c-36fa-4d50-823c-5f1089a6cb97), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:17.954412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d49b3017-eae6-4fc1-895e-b40cf1e383f6 admin admin] Security group rule updated ['f670c468-d418-4477-a93a-73600c309424'] Sep 25 00:56:17.954805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d49b3017-eae6-4fc1-895e-b40cf1e383f6 admin admin] Resource SecurityGroupRule deleted: 7b9c0750-e974-4e5e-89ac-0b3cd41147c2 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:17.955291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d49b3017-eae6-4fc1-895e-b40cf1e383f6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (7b9c0750-e974-4e5e-89ac-0b3cd41147c2), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:17.955753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d49b3017-eae6-4fc1-895e-b40cf1e383f6 admin admin] Security group rule updated ['f670c468-d418-4477-a93a-73600c309424'] Sep 25 00:56:17.956254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d49b3017-eae6-4fc1-895e-b40cf1e383f6 admin admin] Resource SecurityGroupRule deleted: ce4d8cd8-e154-4017-981f-373a4bb172fe {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:17.957059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d49b3017-eae6-4fc1-895e-b40cf1e383f6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (ce4d8cd8-e154-4017-981f-373a4bb172fe), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:17.957677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d49b3017-eae6-4fc1-895e-b40cf1e383f6 admin admin] Security group rule updated ['f670c468-d418-4477-a93a-73600c309424'] Sep 25 00:56:17.958671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d49b3017-eae6-4fc1-895e-b40cf1e383f6 admin admin] Resource SecurityGroupRule deleted: f545bc5a-1d0c-444c-9331-9a2a0c8e2932 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:17.959131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d49b3017-eae6-4fc1-895e-b40cf1e383f6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f545bc5a-1d0c-444c-9331-9a2a0c8e2932), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:17.959450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d49b3017-eae6-4fc1-895e-b40cf1e383f6 admin admin] Security group rule updated ['f670c468-d418-4477-a93a-73600c309424'] Sep 25 00:56:18.744926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1c315416-a721-4894-962e-e2290a2c19f6 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:18Z,description='Default security group',id=8c612e84-0518-4f62-bc18-50017ca73a27,is_default=True,name='default',project_id='a0aa105c58b1474cbe337ec83f25fdfc',revision_number=1,rules=[SecurityGroupRule(2bf52f8b-7c2a-4793-b6c2-b0fb0d37539e),SecurityGroupRule(4c622630-8a98-4808-b85a-741848e1054e),SecurityGroupRule(6c60e6cd-660b-4c5c-9715-aa44438fe936),SecurityGroupRule(8faca27c-041e-4b08-be58-ca8207958f65)],shared=False,stateful=True,updated_at=2022-09-25T00:56:18Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:18.746715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1c315416-a721-4894-962e-e2290a2c19f6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (8c612e84-0518-4f62-bc18-50017ca73a27), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:18.748035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1c315416-a721-4894-962e-e2290a2c19f6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:18Z,description=,direction='egress',ethertype='IPv6',id=2bf52f8b-7c2a-4793-b6c2-b0fb0d37539e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a0aa105c58b1474cbe337ec83f25fdfc',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8c612e84-0518-4f62-bc18-50017ca73a27,updated_at=2022-09-25T00:56:18Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:18.748768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1c315416-a721-4894-962e-e2290a2c19f6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (2bf52f8b-7c2a-4793-b6c2-b0fb0d37539e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:18.749470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1c315416-a721-4894-962e-e2290a2c19f6 admin admin] Security group rule updated ['8c612e84-0518-4f62-bc18-50017ca73a27'] Sep 25 00:56:18.754310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1c315416-a721-4894-962e-e2290a2c19f6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:18Z,description=,direction='egress',ethertype='IPv4',id=4c622630-8a98-4808-b85a-741848e1054e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a0aa105c58b1474cbe337ec83f25fdfc',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8c612e84-0518-4f62-bc18-50017ca73a27,updated_at=2022-09-25T00:56:18Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:18.756840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1c315416-a721-4894-962e-e2290a2c19f6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (4c622630-8a98-4808-b85a-741848e1054e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:18.758508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1c315416-a721-4894-962e-e2290a2c19f6 admin admin] Security group rule updated ['8c612e84-0518-4f62-bc18-50017ca73a27'] Sep 25 00:56:18.774140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1c315416-a721-4894-962e-e2290a2c19f6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:18Z,description=,direction='ingress',ethertype='IPv6',id=6c60e6cd-660b-4c5c-9715-aa44438fe936,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a0aa105c58b1474cbe337ec83f25fdfc',protocol=,remote_address_group_id=,remote_group_id=8c612e84-0518-4f62-bc18-50017ca73a27,remote_ip_prefix=,revision_number=0,security_group_id=8c612e84-0518-4f62-bc18-50017ca73a27,updated_at=2022-09-25T00:56:18Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:18.777883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1c315416-a721-4894-962e-e2290a2c19f6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (6c60e6cd-660b-4c5c-9715-aa44438fe936), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:18.781346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1c315416-a721-4894-962e-e2290a2c19f6 admin admin] Security group rule updated ['8c612e84-0518-4f62-bc18-50017ca73a27'] Sep 25 00:56:18.787430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1c315416-a721-4894-962e-e2290a2c19f6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:18Z,description=,direction='ingress',ethertype='IPv4',id=8faca27c-041e-4b08-be58-ca8207958f65,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a0aa105c58b1474cbe337ec83f25fdfc',protocol=,remote_address_group_id=,remote_group_id=8c612e84-0518-4f62-bc18-50017ca73a27,remote_ip_prefix=,revision_number=0,security_group_id=8c612e84-0518-4f62-bc18-50017ca73a27,updated_at=2022-09-25T00:56:18Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:18.793331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1c315416-a721-4894-962e-e2290a2c19f6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (8faca27c-041e-4b08-be58-ca8207958f65), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:18.794889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1c315416-a721-4894-962e-e2290a2c19f6 admin admin] Security group rule updated ['8c612e84-0518-4f62-bc18-50017ca73a27'] Sep 25 00:56:19.269548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7f48d1d7-b08c-4544-b862-ccee6aa342c2 admin admin] Resource SecurityGroup deleted: 8c612e84-0518-4f62-bc18-50017ca73a27 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:19.270419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7f48d1d7-b08c-4544-b862-ccee6aa342c2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (8c612e84-0518-4f62-bc18-50017ca73a27), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:19.271255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f48d1d7-b08c-4544-b862-ccee6aa342c2 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('8c612e84-0518-4f62-bc18-50017ca73a27',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:56:19.292475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7f48d1d7-b08c-4544-b862-ccee6aa342c2 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('8c612e84-0518-4f62-bc18-50017ca73a27',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:56:19.293225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7f48d1d7-b08c-4544-b862-ccee6aa342c2 admin admin] Resource SecurityGroupRule deleted: 2bf52f8b-7c2a-4793-b6c2-b0fb0d37539e {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:19.294238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7f48d1d7-b08c-4544-b862-ccee6aa342c2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (2bf52f8b-7c2a-4793-b6c2-b0fb0d37539e), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:19.295121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-7f48d1d7-b08c-4544-b862-ccee6aa342c2 admin admin] Security group rule updated ['8c612e84-0518-4f62-bc18-50017ca73a27'] Sep 25 00:56:19.295780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7f48d1d7-b08c-4544-b862-ccee6aa342c2 admin admin] Resource SecurityGroupRule deleted: 4c622630-8a98-4808-b85a-741848e1054e {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:19.296498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7f48d1d7-b08c-4544-b862-ccee6aa342c2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (4c622630-8a98-4808-b85a-741848e1054e), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:19.297285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-7f48d1d7-b08c-4544-b862-ccee6aa342c2 admin admin] Security group rule updated ['8c612e84-0518-4f62-bc18-50017ca73a27'] Sep 25 00:56:19.304535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7f48d1d7-b08c-4544-b862-ccee6aa342c2 admin admin] Resource SecurityGroupRule deleted: 6c60e6cd-660b-4c5c-9715-aa44438fe936 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:19.305731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7f48d1d7-b08c-4544-b862-ccee6aa342c2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (6c60e6cd-660b-4c5c-9715-aa44438fe936), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:19.306379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-7f48d1d7-b08c-4544-b862-ccee6aa342c2 admin admin] Security group rule updated ['8c612e84-0518-4f62-bc18-50017ca73a27'] Sep 25 00:56:19.307116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7f48d1d7-b08c-4544-b862-ccee6aa342c2 admin admin] Resource SecurityGroupRule deleted: 8faca27c-041e-4b08-be58-ca8207958f65 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:19.307548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7f48d1d7-b08c-4544-b862-ccee6aa342c2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (8faca27c-041e-4b08-be58-ca8207958f65), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:19.307948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-7f48d1d7-b08c-4544-b862-ccee6aa342c2 admin admin] Security group rule updated ['8c612e84-0518-4f62-bc18-50017ca73a27'] Sep 25 00:56:19.578007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:264 started Sep 25 00:56:19.582667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dec9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=307000000,duration_sec=542,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:19.584598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:56:19.585177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:264 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 00:56:20.840374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6cda43ec-e20a-4589-9cc6-4db930244936 service neutron] Resource Port 9618d105-fdf7-4a07-9a29-e94ba03b6c41 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=9618d105-fdf7-4a07-9a29-e94ba03b6c41,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=9618d105-fdf7-4a07-9a29-e94ba03b6c41,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:20.841066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6cda43ec-e20a-4589-9cc6-4db930244936 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (9618d105-fdf7-4a07-9a29-e94ba03b6c41), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:21.389427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6cda43ec-e20a-4589-9cc6-4db930244936 service neutron] Resource Port 9618d105-fdf7-4a07-9a29-e94ba03b6c41 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=9618d105-fdf7-4a07-9a29-e94ba03b6c41,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=9618d105-fdf7-4a07-9a29-e94ba03b6c41,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=9618d105-fdf7-4a07-9a29-e94ba03b6c41,segment=NetworkSegment(47b88da7-e2fb-4714-bbd5-a18aae097f49),segment_id=47b88da7-e2fb-4714-bbd5-a18aae097f49)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:21.390940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6cda43ec-e20a-4589-9cc6-4db930244936 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (9618d105-fdf7-4a07-9a29-e94ba03b6c41), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:21.583718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:265 started Sep 25 00:56:21.587400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834decb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=312000000,duration_sec=544,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:21.588973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:56:21.589479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:265 - starting polling. Elapsed:0.006 Sep 25 00:56:21.592126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:21.599116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:265 - port information retrieved. Elapsed:0.015 Sep 25 00:56:21.601440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:265 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Sep 25 00:56:21.728789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f882a7f9-ad14-4b6a-b52c-88c6f4b235a5 service neutron] Resource Port 344eed51-ca03-4da0-b7a1-415ff8227472 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=344eed51-ca03-4da0-b7a1-415ff8227472,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=344eed51-ca03-4da0-b7a1-415ff8227472,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:21.730220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f882a7f9-ad14-4b6a-b52c-88c6f4b235a5 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (344eed51-ca03-4da0-b7a1-415ff8227472), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:21.906027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c003db89-458a-4798-ac5f-a6d24ce96c9f tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:56:20Z,data_plane_status=None,description='',device_id='4eb3d7d6-970a-4c8d-bd97-9982ff56f3b9',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=96168749-3e0f-462f-9aed-adacd4fb28c0,mac_address=fa:16:3e:8b:e6:fd,name='',network_id=334cdfa6-14bd-4f9b-b93c-dbd866cdb6bb,numa_affinity_policy=,project_id='f09655506e354c9d991f4df9a92f4086',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(96168749-3e0f-462f-9aed-adacd4fb28c0),security_group_ids=set([e1c787d9-5e00-43b4-af6c-89d3769b8873]),status='DOWN',updated_at=2022-09-25T00:56:21Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:21.907931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c003db89-458a-4798-ac5f-a6d24ce96c9f tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (96168749-3e0f-462f-9aed-adacd4fb28c0), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:21.908746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c003db89-458a-4798-ac5f-a6d24ce96c9f tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Security group member updated {'e1c787d9-5e00-43b4-af6c-89d3769b8873'} Sep 25 00:56:21.991157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-13ac84bb-9e62-4be6-8348-99684a38038d service neutron] Resource Port 1f1b4ee1-4f64-49a9-bb20-210b866dfbd5 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=1f1b4ee1-4f64-49a9-bb20-210b866dfbd5,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=1f1b4ee1-4f64-49a9-bb20-210b866dfbd5,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:21.991635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-13ac84bb-9e62-4be6-8348-99684a38038d service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (1f1b4ee1-4f64-49a9-bb20-210b866dfbd5), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:22.807382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f882a7f9-ad14-4b6a-b52c-88c6f4b235a5 service neutron] Resource Port 344eed51-ca03-4da0-b7a1-415ff8227472 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=344eed51-ca03-4da0-b7a1-415ff8227472,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=344eed51-ca03-4da0-b7a1-415ff8227472,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=344eed51-ca03-4da0-b7a1-415ff8227472,segment=NetworkSegment(6dee2139-73a3-4d84-b994-05c9c1e85f42),segment_id=6dee2139-73a3-4d84-b994-05c9c1e85f42)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:22.809001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f882a7f9-ad14-4b6a-b52c-88c6f4b235a5 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (344eed51-ca03-4da0-b7a1-415ff8227472), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:22.831752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-13ac84bb-9e62-4be6-8348-99684a38038d service neutron] Resource Port 1f1b4ee1-4f64-49a9-bb20-210b866dfbd5 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=1f1b4ee1-4f64-49a9-bb20-210b866dfbd5,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=1f1b4ee1-4f64-49a9-bb20-210b866dfbd5,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=1f1b4ee1-4f64-49a9-bb20-210b866dfbd5,segment=NetworkSegment(6dee2139-73a3-4d84-b994-05c9c1e85f42),segment_id=6dee2139-73a3-4d84-b994-05c9c1e85f42)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:22.831752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-13ac84bb-9e62-4be6-8348-99684a38038d service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (1f1b4ee1-4f64-49a9-bb20-210b866dfbd5), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:23.585937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:266 started Sep 25 00:56:23.590254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834decd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=315000000,duration_sec=546,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:23.590854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:56:23.591187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:266 - starting polling. Elapsed:0.006 Sep 25 00:56:23.594677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:23.604309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:266 - port information retrieved. Elapsed:0.019 Sep 25 00:56:23.604753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:266 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.020 Sep 25 00:56:25.586304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:267 started Sep 25 00:56:25.589433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834decf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=315000000,duration_sec=548,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:25.590469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:56:25.590929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:267 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:56:26.170015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f9fbb36c-c400-4a78-9108-45a802b3487d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:25Z,description='Default security group',id=6faa35a0-cb0b-4b59-b53a-c16bca072770,is_default=True,name='default',project_id='48f37c93452a40fb9f1070965497a755',revision_number=1,rules=[SecurityGroupRule(9429c1a9-70a3-41b2-b794-459825463608),SecurityGroupRule(d9b12345-4051-4d57-943d-118618be50b8),SecurityGroupRule(eeb4f279-66b9-4ec3-9628-a4b95dc29ac8),SecurityGroupRule(f728811f-7ff9-4a82-86dd-5605ea07c2b0)],shared=False,stateful=True,updated_at=2022-09-25T00:56:25Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:26.173812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f9fbb36c-c400-4a78-9108-45a802b3487d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (6faa35a0-cb0b-4b59-b53a-c16bca072770), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:26.176150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f9fbb36c-c400-4a78-9108-45a802b3487d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:26Z,description=,direction='egress',ethertype='IPv4',id=9429c1a9-70a3-41b2-b794-459825463608,normalized_cidr=None,port_range_max=,port_range_min=,project_id='48f37c93452a40fb9f1070965497a755',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6faa35a0-cb0b-4b59-b53a-c16bca072770,updated_at=2022-09-25T00:56:26Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:26.176522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f9fbb36c-c400-4a78-9108-45a802b3487d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (9429c1a9-70a3-41b2-b794-459825463608), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:26.176864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f9fbb36c-c400-4a78-9108-45a802b3487d admin admin] Security group rule updated ['6faa35a0-cb0b-4b59-b53a-c16bca072770'] Sep 25 00:56:26.177601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f9fbb36c-c400-4a78-9108-45a802b3487d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:25Z,description=,direction='ingress',ethertype='IPv4',id=d9b12345-4051-4d57-943d-118618be50b8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='48f37c93452a40fb9f1070965497a755',protocol=,remote_address_group_id=,remote_group_id=6faa35a0-cb0b-4b59-b53a-c16bca072770,remote_ip_prefix=,revision_number=0,security_group_id=6faa35a0-cb0b-4b59-b53a-c16bca072770,updated_at=2022-09-25T00:56:25Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:26.181613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f9fbb36c-c400-4a78-9108-45a802b3487d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (d9b12345-4051-4d57-943d-118618be50b8), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:26.181962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f9fbb36c-c400-4a78-9108-45a802b3487d admin admin] Security group rule updated ['6faa35a0-cb0b-4b59-b53a-c16bca072770'] Sep 25 00:56:26.182719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f9fbb36c-c400-4a78-9108-45a802b3487d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:26Z,description=,direction='egress',ethertype='IPv6',id=eeb4f279-66b9-4ec3-9628-a4b95dc29ac8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='48f37c93452a40fb9f1070965497a755',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6faa35a0-cb0b-4b59-b53a-c16bca072770,updated_at=2022-09-25T00:56:26Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:26.183252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f9fbb36c-c400-4a78-9108-45a802b3487d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (eeb4f279-66b9-4ec3-9628-a4b95dc29ac8), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:26.183589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f9fbb36c-c400-4a78-9108-45a802b3487d admin admin] Security group rule updated ['6faa35a0-cb0b-4b59-b53a-c16bca072770'] Sep 25 00:56:26.184259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f9fbb36c-c400-4a78-9108-45a802b3487d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:26Z,description=,direction='ingress',ethertype='IPv6',id=f728811f-7ff9-4a82-86dd-5605ea07c2b0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='48f37c93452a40fb9f1070965497a755',protocol=,remote_address_group_id=,remote_group_id=6faa35a0-cb0b-4b59-b53a-c16bca072770,remote_ip_prefix=,revision_number=0,security_group_id=6faa35a0-cb0b-4b59-b53a-c16bca072770,updated_at=2022-09-25T00:56:26Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:26.185893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f9fbb36c-c400-4a78-9108-45a802b3487d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f728811f-7ff9-4a82-86dd-5605ea07c2b0), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:26.186248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f9fbb36c-c400-4a78-9108-45a802b3487d admin admin] Security group rule updated ['6faa35a0-cb0b-4b59-b53a-c16bca072770'] Sep 25 00:56:26.308220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c54fb8c3-4f5f-4e70-b8a1-0cfbc71cf247 admin admin] Resource SecurityGroup deleted: 6faa35a0-cb0b-4b59-b53a-c16bca072770 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:26.308722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c54fb8c3-4f5f-4e70-b8a1-0cfbc71cf247 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (6faa35a0-cb0b-4b59-b53a-c16bca072770), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:26.309185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c54fb8c3-4f5f-4e70-b8a1-0cfbc71cf247 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('6faa35a0-cb0b-4b59-b53a-c16bca072770',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:56:26.327121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c54fb8c3-4f5f-4e70-b8a1-0cfbc71cf247 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('6faa35a0-cb0b-4b59-b53a-c16bca072770',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:56:26.327683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c54fb8c3-4f5f-4e70-b8a1-0cfbc71cf247 admin admin] Resource SecurityGroupRule deleted: 9429c1a9-70a3-41b2-b794-459825463608 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:26.328169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c54fb8c3-4f5f-4e70-b8a1-0cfbc71cf247 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (9429c1a9-70a3-41b2-b794-459825463608), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:26.328598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c54fb8c3-4f5f-4e70-b8a1-0cfbc71cf247 admin admin] Security group rule updated ['6faa35a0-cb0b-4b59-b53a-c16bca072770'] Sep 25 00:56:26.329129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c54fb8c3-4f5f-4e70-b8a1-0cfbc71cf247 admin admin] Resource SecurityGroupRule deleted: d9b12345-4051-4d57-943d-118618be50b8 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:26.329614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c54fb8c3-4f5f-4e70-b8a1-0cfbc71cf247 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (d9b12345-4051-4d57-943d-118618be50b8), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:26.330009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c54fb8c3-4f5f-4e70-b8a1-0cfbc71cf247 admin admin] Security group rule updated ['6faa35a0-cb0b-4b59-b53a-c16bca072770'] Sep 25 00:56:26.330458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c54fb8c3-4f5f-4e70-b8a1-0cfbc71cf247 admin admin] Resource SecurityGroupRule deleted: eeb4f279-66b9-4ec3-9628-a4b95dc29ac8 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:26.330899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c54fb8c3-4f5f-4e70-b8a1-0cfbc71cf247 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (eeb4f279-66b9-4ec3-9628-a4b95dc29ac8), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:26.331287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c54fb8c3-4f5f-4e70-b8a1-0cfbc71cf247 admin admin] Security group rule updated ['6faa35a0-cb0b-4b59-b53a-c16bca072770'] Sep 25 00:56:26.332223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c54fb8c3-4f5f-4e70-b8a1-0cfbc71cf247 admin admin] Resource SecurityGroupRule deleted: f728811f-7ff9-4a82-86dd-5605ea07c2b0 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:26.333565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c54fb8c3-4f5f-4e70-b8a1-0cfbc71cf247 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f728811f-7ff9-4a82-86dd-5605ea07c2b0), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:26.333991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c54fb8c3-4f5f-4e70-b8a1-0cfbc71cf247 admin admin] Security group rule updated ['6faa35a0-cb0b-4b59-b53a-c16bca072770'] Sep 25 00:56:26.744720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4d3795dd-66a7-4eca-92de-aa87e2c7380b admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:26Z,description='Default security group',id=a15d4e35-e003-4bad-aedc-dc70126ac0ea,is_default=True,name='default',project_id='0ba384f2387f43539de482688bcccf66',revision_number=1,rules=[SecurityGroupRule(277dad75-63b8-4be4-8b0c-69249a75c925),SecurityGroupRule(78d50e73-66c3-42cd-902e-3dc878cbf43a),SecurityGroupRule(cf6cdf01-8897-4595-aa37-4d7db15ac75e),SecurityGroupRule(f66163c7-0592-4b28-ac86-1237cb1b7c46)],shared=False,stateful=True,updated_at=2022-09-25T00:56:26Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:26.745420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4d3795dd-66a7-4eca-92de-aa87e2c7380b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (a15d4e35-e003-4bad-aedc-dc70126ac0ea), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:26.745765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4d3795dd-66a7-4eca-92de-aa87e2c7380b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:26Z,description=,direction='ingress',ethertype='IPv6',id=277dad75-63b8-4be4-8b0c-69249a75c925,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0ba384f2387f43539de482688bcccf66',protocol=,remote_address_group_id=,remote_group_id=a15d4e35-e003-4bad-aedc-dc70126ac0ea,remote_ip_prefix=,revision_number=0,security_group_id=a15d4e35-e003-4bad-aedc-dc70126ac0ea,updated_at=2022-09-25T00:56:26Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:26.746133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4d3795dd-66a7-4eca-92de-aa87e2c7380b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (277dad75-63b8-4be4-8b0c-69249a75c925), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:26.746466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-4d3795dd-66a7-4eca-92de-aa87e2c7380b admin admin] Security group rule updated ['a15d4e35-e003-4bad-aedc-dc70126ac0ea'] Sep 25 00:56:26.747139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4d3795dd-66a7-4eca-92de-aa87e2c7380b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:26Z,description=,direction='egress',ethertype='IPv6',id=78d50e73-66c3-42cd-902e-3dc878cbf43a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0ba384f2387f43539de482688bcccf66',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a15d4e35-e003-4bad-aedc-dc70126ac0ea,updated_at=2022-09-25T00:56:26Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:26.747618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4d3795dd-66a7-4eca-92de-aa87e2c7380b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (78d50e73-66c3-42cd-902e-3dc878cbf43a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:26.747949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-4d3795dd-66a7-4eca-92de-aa87e2c7380b admin admin] Security group rule updated ['a15d4e35-e003-4bad-aedc-dc70126ac0ea'] Sep 25 00:56:26.748601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4d3795dd-66a7-4eca-92de-aa87e2c7380b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:26Z,description=,direction='egress',ethertype='IPv4',id=cf6cdf01-8897-4595-aa37-4d7db15ac75e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0ba384f2387f43539de482688bcccf66',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a15d4e35-e003-4bad-aedc-dc70126ac0ea,updated_at=2022-09-25T00:56:26Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:26.748964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4d3795dd-66a7-4eca-92de-aa87e2c7380b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (cf6cdf01-8897-4595-aa37-4d7db15ac75e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:26.749312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-4d3795dd-66a7-4eca-92de-aa87e2c7380b admin admin] Security group rule updated ['a15d4e35-e003-4bad-aedc-dc70126ac0ea'] Sep 25 00:56:26.749956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4d3795dd-66a7-4eca-92de-aa87e2c7380b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:26Z,description=,direction='ingress',ethertype='IPv4',id=f66163c7-0592-4b28-ac86-1237cb1b7c46,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0ba384f2387f43539de482688bcccf66',protocol=,remote_address_group_id=,remote_group_id=a15d4e35-e003-4bad-aedc-dc70126ac0ea,remote_ip_prefix=,revision_number=0,security_group_id=a15d4e35-e003-4bad-aedc-dc70126ac0ea,updated_at=2022-09-25T00:56:26Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:26.750304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4d3795dd-66a7-4eca-92de-aa87e2c7380b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f66163c7-0592-4b28-ac86-1237cb1b7c46), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:26.750627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-4d3795dd-66a7-4eca-92de-aa87e2c7380b admin admin] Security group rule updated ['a15d4e35-e003-4bad-aedc-dc70126ac0ea'] Sep 25 00:56:26.879554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-aa5ca258-55bb-4532-8d51-231f96daab02 admin admin] Resource SecurityGroup deleted: a15d4e35-e003-4bad-aedc-dc70126ac0ea {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:26.880097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-aa5ca258-55bb-4532-8d51-231f96daab02 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (a15d4e35-e003-4bad-aedc-dc70126ac0ea), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:26.880884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa5ca258-55bb-4532-8d51-231f96daab02 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('a15d4e35-e003-4bad-aedc-dc70126ac0ea',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:56:26.897191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-aa5ca258-55bb-4532-8d51-231f96daab02 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('a15d4e35-e003-4bad-aedc-dc70126ac0ea',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:56:26.898104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-aa5ca258-55bb-4532-8d51-231f96daab02 admin admin] Resource SecurityGroupRule deleted: 277dad75-63b8-4be4-8b0c-69249a75c925 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:26.898612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-aa5ca258-55bb-4532-8d51-231f96daab02 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (277dad75-63b8-4be4-8b0c-69249a75c925), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:26.899140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-aa5ca258-55bb-4532-8d51-231f96daab02 admin admin] Security group rule updated ['a15d4e35-e003-4bad-aedc-dc70126ac0ea'] Sep 25 00:56:26.899918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-aa5ca258-55bb-4532-8d51-231f96daab02 admin admin] Resource SecurityGroupRule deleted: 78d50e73-66c3-42cd-902e-3dc878cbf43a {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:26.900368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-aa5ca258-55bb-4532-8d51-231f96daab02 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (78d50e73-66c3-42cd-902e-3dc878cbf43a), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:26.900814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-aa5ca258-55bb-4532-8d51-231f96daab02 admin admin] Security group rule updated ['a15d4e35-e003-4bad-aedc-dc70126ac0ea'] Sep 25 00:56:26.902011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-aa5ca258-55bb-4532-8d51-231f96daab02 admin admin] Resource SecurityGroupRule deleted: cf6cdf01-8897-4595-aa37-4d7db15ac75e {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:26.902774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-aa5ca258-55bb-4532-8d51-231f96daab02 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (cf6cdf01-8897-4595-aa37-4d7db15ac75e), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:26.903151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-aa5ca258-55bb-4532-8d51-231f96daab02 admin admin] Security group rule updated ['a15d4e35-e003-4bad-aedc-dc70126ac0ea'] Sep 25 00:56:26.903611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-aa5ca258-55bb-4532-8d51-231f96daab02 admin admin] Resource SecurityGroupRule deleted: f66163c7-0592-4b28-ac86-1237cb1b7c46 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:26.904195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-aa5ca258-55bb-4532-8d51-231f96daab02 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f66163c7-0592-4b28-ac86-1237cb1b7c46), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:26.904618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-aa5ca258-55bb-4532-8d51-231f96daab02 admin admin] Security group rule updated ['a15d4e35-e003-4bad-aedc-dc70126ac0ea'] Sep 25 00:56:27.587337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:268 started Sep 25 00:56:27.590884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ded1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=316000000,duration_sec=550,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:27.591759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:56:27.592288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:268 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:56:28.395505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c3e57e74-38d5-4f5c-8247-9561d48e2d54 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:28Z,description='Default security group',id=7f3c492f-ec77-4e49-8fc3-dc7109f28875,is_default=True,name='default',project_id='89af4119fa954844a05b4b5cd47b1cd9',revision_number=1,rules=[SecurityGroupRule(0dd10234-cc04-4ac7-98f8-a3cd9b687626),SecurityGroupRule(0e1783ab-2050-4efc-9182-06b13d88a277),SecurityGroupRule(3b5ee6a1-f0e5-4919-98d3-f0c222746254),SecurityGroupRule(8a449000-40e3-4488-8906-b14ed4e353ed)],shared=False,stateful=True,updated_at=2022-09-25T00:56:28Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:28.396900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c3e57e74-38d5-4f5c-8247-9561d48e2d54 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (7f3c492f-ec77-4e49-8fc3-dc7109f28875), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:28.397867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c3e57e74-38d5-4f5c-8247-9561d48e2d54 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:28Z,description=,direction='ingress',ethertype='IPv4',id=0dd10234-cc04-4ac7-98f8-a3cd9b687626,normalized_cidr=None,port_range_max=,port_range_min=,project_id='89af4119fa954844a05b4b5cd47b1cd9',protocol=,remote_address_group_id=,remote_group_id=7f3c492f-ec77-4e49-8fc3-dc7109f28875,remote_ip_prefix=,revision_number=0,security_group_id=7f3c492f-ec77-4e49-8fc3-dc7109f28875,updated_at=2022-09-25T00:56:28Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:28.398238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c3e57e74-38d5-4f5c-8247-9561d48e2d54 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (0dd10234-cc04-4ac7-98f8-a3cd9b687626), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:28.398587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c3e57e74-38d5-4f5c-8247-9561d48e2d54 admin admin] Security group rule updated ['7f3c492f-ec77-4e49-8fc3-dc7109f28875'] Sep 25 00:56:28.399333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c3e57e74-38d5-4f5c-8247-9561d48e2d54 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:28Z,description=,direction='ingress',ethertype='IPv6',id=0e1783ab-2050-4efc-9182-06b13d88a277,normalized_cidr=None,port_range_max=,port_range_min=,project_id='89af4119fa954844a05b4b5cd47b1cd9',protocol=,remote_address_group_id=,remote_group_id=7f3c492f-ec77-4e49-8fc3-dc7109f28875,remote_ip_prefix=,revision_number=0,security_group_id=7f3c492f-ec77-4e49-8fc3-dc7109f28875,updated_at=2022-09-25T00:56:28Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:28.399738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c3e57e74-38d5-4f5c-8247-9561d48e2d54 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (0e1783ab-2050-4efc-9182-06b13d88a277), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:28.400349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c3e57e74-38d5-4f5c-8247-9561d48e2d54 admin admin] Security group rule updated ['7f3c492f-ec77-4e49-8fc3-dc7109f28875'] Sep 25 00:56:28.401200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c3e57e74-38d5-4f5c-8247-9561d48e2d54 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:28Z,description=,direction='egress',ethertype='IPv6',id=3b5ee6a1-f0e5-4919-98d3-f0c222746254,normalized_cidr=None,port_range_max=,port_range_min=,project_id='89af4119fa954844a05b4b5cd47b1cd9',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7f3c492f-ec77-4e49-8fc3-dc7109f28875,updated_at=2022-09-25T00:56:28Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:28.401548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c3e57e74-38d5-4f5c-8247-9561d48e2d54 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (3b5ee6a1-f0e5-4919-98d3-f0c222746254), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:28.401885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c3e57e74-38d5-4f5c-8247-9561d48e2d54 admin admin] Security group rule updated ['7f3c492f-ec77-4e49-8fc3-dc7109f28875'] Sep 25 00:56:28.402536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c3e57e74-38d5-4f5c-8247-9561d48e2d54 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:28Z,description=,direction='egress',ethertype='IPv4',id=8a449000-40e3-4488-8906-b14ed4e353ed,normalized_cidr=None,port_range_max=,port_range_min=,project_id='89af4119fa954844a05b4b5cd47b1cd9',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7f3c492f-ec77-4e49-8fc3-dc7109f28875,updated_at=2022-09-25T00:56:28Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:28.402897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c3e57e74-38d5-4f5c-8247-9561d48e2d54 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (8a449000-40e3-4488-8906-b14ed4e353ed), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:28.403569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c3e57e74-38d5-4f5c-8247-9561d48e2d54 admin admin] Security group rule updated ['7f3c492f-ec77-4e49-8fc3-dc7109f28875'] Sep 25 00:56:28.542889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b5f47d52-55fe-470d-9b10-49e45bbca247 admin admin] Resource SecurityGroup deleted: 7f3c492f-ec77-4e49-8fc3-dc7109f28875 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:28.544534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b5f47d52-55fe-470d-9b10-49e45bbca247 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (7f3c492f-ec77-4e49-8fc3-dc7109f28875), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:28.545134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5f47d52-55fe-470d-9b10-49e45bbca247 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('7f3c492f-ec77-4e49-8fc3-dc7109f28875',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:56:28.560153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b5f47d52-55fe-470d-9b10-49e45bbca247 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('7f3c492f-ec77-4e49-8fc3-dc7109f28875',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:56:28.560728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b5f47d52-55fe-470d-9b10-49e45bbca247 admin admin] Resource SecurityGroupRule deleted: 0dd10234-cc04-4ac7-98f8-a3cd9b687626 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:28.561206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b5f47d52-55fe-470d-9b10-49e45bbca247 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (0dd10234-cc04-4ac7-98f8-a3cd9b687626), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:28.561954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b5f47d52-55fe-470d-9b10-49e45bbca247 admin admin] Security group rule updated ['7f3c492f-ec77-4e49-8fc3-dc7109f28875'] Sep 25 00:56:28.562686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b5f47d52-55fe-470d-9b10-49e45bbca247 admin admin] Resource SecurityGroupRule deleted: 0e1783ab-2050-4efc-9182-06b13d88a277 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:28.563225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b5f47d52-55fe-470d-9b10-49e45bbca247 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (0e1783ab-2050-4efc-9182-06b13d88a277), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:28.563805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b5f47d52-55fe-470d-9b10-49e45bbca247 admin admin] Security group rule updated ['7f3c492f-ec77-4e49-8fc3-dc7109f28875'] Sep 25 00:56:28.564422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b5f47d52-55fe-470d-9b10-49e45bbca247 admin admin] Resource SecurityGroupRule deleted: 3b5ee6a1-f0e5-4919-98d3-f0c222746254 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:28.564842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b5f47d52-55fe-470d-9b10-49e45bbca247 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (3b5ee6a1-f0e5-4919-98d3-f0c222746254), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:28.565236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b5f47d52-55fe-470d-9b10-49e45bbca247 admin admin] Security group rule updated ['7f3c492f-ec77-4e49-8fc3-dc7109f28875'] Sep 25 00:56:28.565733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b5f47d52-55fe-470d-9b10-49e45bbca247 admin admin] Resource SecurityGroupRule deleted: 8a449000-40e3-4488-8906-b14ed4e353ed {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:28.566192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b5f47d52-55fe-470d-9b10-49e45bbca247 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (8a449000-40e3-4488-8906-b14ed4e353ed), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:28.566584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b5f47d52-55fe-470d-9b10-49e45bbca247 admin admin] Security group rule updated ['7f3c492f-ec77-4e49-8fc3-dc7109f28875'] Sep 25 00:56:29.588466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:269 started Sep 25 00:56:29.592038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ded3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=317000000,duration_sec=552,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:29.592994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:56:29.593652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:269 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:56:30.166625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-13fb3147-605f-46e1-81c3-8fd0f449db1f service neutron] Resource Port 96168749-3e0f-462f-9aed-adacd4fb28c0 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=96168749-3e0f-462f-9aed-adacd4fb28c0,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=96168749-3e0f-462f-9aed-adacd4fb28c0,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:30.167275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-13fb3147-605f-46e1-81c3-8fd0f449db1f service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (96168749-3e0f-462f-9aed-adacd4fb28c0), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:30.467135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-13fb3147-605f-46e1-81c3-8fd0f449db1f service neutron] Resource Port 96168749-3e0f-462f-9aed-adacd4fb28c0 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=96168749-3e0f-462f-9aed-adacd4fb28c0,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=96168749-3e0f-462f-9aed-adacd4fb28c0,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=96168749-3e0f-462f-9aed-adacd4fb28c0,segment=NetworkSegment(60226fdd-ab84-4bff-9bed-5551adf26f89),segment_id=60226fdd-ab84-4bff-9bed-5551adf26f89)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:30.467844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-13fb3147-605f-46e1-81c3-8fd0f449db1f service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (96168749-3e0f-462f-9aed-adacd4fb28c0), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:31.589053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:270 started Sep 25 00:56:31.591475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ded5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=317000000,duration_sec=554,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:31.592041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:56:31.592374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:270 - starting polling. Elapsed:0.003 Sep 25 00:56:31.594719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:31.597790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:270 - port information retrieved. Elapsed:0.009 Sep 25 00:56:31.598145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:270 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 25 00:56:33.589775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:271 started Sep 25 00:56:33.592919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ded7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=318000000,duration_sec=556,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:33.593550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:56:33.593904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:271 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:56:34.265687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2e4fe3b5-a851-48b5-bd1b-1ebaa531be0f admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:33Z,description='Default security group',id=2f63501f-cd4b-4cba-bd6b-7b5761249b23,is_default=True,name='default',project_id='176ceec8a49a484a99c0e32ca07a29f0',revision_number=1,rules=[SecurityGroupRule(bea59323-6d51-4b08-a34c-e01d81550ed1),SecurityGroupRule(c712ca85-3ac8-4a8f-a409-617e2ea8c91b),SecurityGroupRule(d3f68ac5-43f4-465a-b333-954d83c9d0c6),SecurityGroupRule(e58d36ab-a483-44f1-aaa3-91d8c37ca30a)],shared=False,stateful=True,updated_at=2022-09-25T00:56:33Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:34.265687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2e4fe3b5-a851-48b5-bd1b-1ebaa531be0f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (2f63501f-cd4b-4cba-bd6b-7b5761249b23), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:34.266454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2e4fe3b5-a851-48b5-bd1b-1ebaa531be0f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:33Z,description=,direction='ingress',ethertype='IPv6',id=bea59323-6d51-4b08-a34c-e01d81550ed1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='176ceec8a49a484a99c0e32ca07a29f0',protocol=,remote_address_group_id=,remote_group_id=2f63501f-cd4b-4cba-bd6b-7b5761249b23,remote_ip_prefix=,revision_number=0,security_group_id=2f63501f-cd4b-4cba-bd6b-7b5761249b23,updated_at=2022-09-25T00:56:33Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:34.266454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2e4fe3b5-a851-48b5-bd1b-1ebaa531be0f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (bea59323-6d51-4b08-a34c-e01d81550ed1), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:34.266898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2e4fe3b5-a851-48b5-bd1b-1ebaa531be0f admin admin] Security group rule updated ['2f63501f-cd4b-4cba-bd6b-7b5761249b23'] Sep 25 00:56:34.269110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2e4fe3b5-a851-48b5-bd1b-1ebaa531be0f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:33Z,description=,direction='egress',ethertype='IPv4',id=c712ca85-3ac8-4a8f-a409-617e2ea8c91b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='176ceec8a49a484a99c0e32ca07a29f0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2f63501f-cd4b-4cba-bd6b-7b5761249b23,updated_at=2022-09-25T00:56:33Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:34.269571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2e4fe3b5-a851-48b5-bd1b-1ebaa531be0f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (c712ca85-3ac8-4a8f-a409-617e2ea8c91b), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:34.269961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2e4fe3b5-a851-48b5-bd1b-1ebaa531be0f admin admin] Security group rule updated ['2f63501f-cd4b-4cba-bd6b-7b5761249b23'] Sep 25 00:56:34.271597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2e4fe3b5-a851-48b5-bd1b-1ebaa531be0f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:33Z,description=,direction='egress',ethertype='IPv6',id=d3f68ac5-43f4-465a-b333-954d83c9d0c6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='176ceec8a49a484a99c0e32ca07a29f0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2f63501f-cd4b-4cba-bd6b-7b5761249b23,updated_at=2022-09-25T00:56:33Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:34.271962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2e4fe3b5-a851-48b5-bd1b-1ebaa531be0f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (d3f68ac5-43f4-465a-b333-954d83c9d0c6), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:34.272972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2e4fe3b5-a851-48b5-bd1b-1ebaa531be0f admin admin] Security group rule updated ['2f63501f-cd4b-4cba-bd6b-7b5761249b23'] Sep 25 00:56:34.274116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2e4fe3b5-a851-48b5-bd1b-1ebaa531be0f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:33Z,description=,direction='ingress',ethertype='IPv4',id=e58d36ab-a483-44f1-aaa3-91d8c37ca30a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='176ceec8a49a484a99c0e32ca07a29f0',protocol=,remote_address_group_id=,remote_group_id=2f63501f-cd4b-4cba-bd6b-7b5761249b23,remote_ip_prefix=,revision_number=0,security_group_id=2f63501f-cd4b-4cba-bd6b-7b5761249b23,updated_at=2022-09-25T00:56:33Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:34.274482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2e4fe3b5-a851-48b5-bd1b-1ebaa531be0f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (e58d36ab-a483-44f1-aaa3-91d8c37ca30a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:34.274814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2e4fe3b5-a851-48b5-bd1b-1ebaa531be0f admin admin] Security group rule updated ['2f63501f-cd4b-4cba-bd6b-7b5761249b23'] Sep 25 00:56:34.561628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f0798031-0d4b-4f22-8d20-ed4cf987dbcb admin admin] Resource SecurityGroup deleted: 2f63501f-cd4b-4cba-bd6b-7b5761249b23 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:34.562243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f0798031-0d4b-4f22-8d20-ed4cf987dbcb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (2f63501f-cd4b-4cba-bd6b-7b5761249b23), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:34.562708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0798031-0d4b-4f22-8d20-ed4cf987dbcb admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2f63501f-cd4b-4cba-bd6b-7b5761249b23',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:56:34.578524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f0798031-0d4b-4f22-8d20-ed4cf987dbcb admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2f63501f-cd4b-4cba-bd6b-7b5761249b23',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:56:34.579033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f0798031-0d4b-4f22-8d20-ed4cf987dbcb admin admin] Resource SecurityGroupRule deleted: bea59323-6d51-4b08-a34c-e01d81550ed1 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:34.579402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f0798031-0d4b-4f22-8d20-ed4cf987dbcb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (bea59323-6d51-4b08-a34c-e01d81550ed1), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:34.579778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f0798031-0d4b-4f22-8d20-ed4cf987dbcb admin admin] Security group rule updated ['2f63501f-cd4b-4cba-bd6b-7b5761249b23'] Sep 25 00:56:34.580152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f0798031-0d4b-4f22-8d20-ed4cf987dbcb admin admin] Resource SecurityGroupRule deleted: c712ca85-3ac8-4a8f-a409-617e2ea8c91b {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:34.580495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f0798031-0d4b-4f22-8d20-ed4cf987dbcb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (c712ca85-3ac8-4a8f-a409-617e2ea8c91b), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:34.580812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f0798031-0d4b-4f22-8d20-ed4cf987dbcb admin admin] Security group rule updated ['2f63501f-cd4b-4cba-bd6b-7b5761249b23'] Sep 25 00:56:34.581183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f0798031-0d4b-4f22-8d20-ed4cf987dbcb admin admin] Resource SecurityGroupRule deleted: d3f68ac5-43f4-465a-b333-954d83c9d0c6 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:34.581595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f0798031-0d4b-4f22-8d20-ed4cf987dbcb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (d3f68ac5-43f4-465a-b333-954d83c9d0c6), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:34.581911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f0798031-0d4b-4f22-8d20-ed4cf987dbcb admin admin] Security group rule updated ['2f63501f-cd4b-4cba-bd6b-7b5761249b23'] Sep 25 00:56:34.582298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f0798031-0d4b-4f22-8d20-ed4cf987dbcb admin admin] Resource SecurityGroupRule deleted: e58d36ab-a483-44f1-aaa3-91d8c37ca30a {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:34.582874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f0798031-0d4b-4f22-8d20-ed4cf987dbcb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (e58d36ab-a483-44f1-aaa3-91d8c37ca30a), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:34.583209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f0798031-0d4b-4f22-8d20-ed4cf987dbcb admin admin] Security group rule updated ['2f63501f-cd4b-4cba-bd6b-7b5761249b23'] Sep 25 00:56:35.318204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5fcc5b1a-dfc0-49d3-865e-e8c01e07e001 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:35Z,description='Default security group',id=83cd9e5b-9519-48ef-b64b-2d5af35e72c8,is_default=True,name='default',project_id='7cdbe3fc97bf4747a0f09b7fae69c462',revision_number=1,rules=[SecurityGroupRule(7152f86c-db14-4980-b054-e2e838fc7b49),SecurityGroupRule(764fa5a5-61d5-40da-b0e5-07ab0f4afe16),SecurityGroupRule(829343d5-8b58-4561-8518-944b40db25b7),SecurityGroupRule(dd9b0a40-0778-403b-83bb-ca22a7b97478)],shared=False,stateful=True,updated_at=2022-09-25T00:56:35Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:35.318829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5fcc5b1a-dfc0-49d3-865e-e8c01e07e001 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (83cd9e5b-9519-48ef-b64b-2d5af35e72c8), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:35.320387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5fcc5b1a-dfc0-49d3-865e-e8c01e07e001 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:35Z,description=,direction='ingress',ethertype='IPv6',id=7152f86c-db14-4980-b054-e2e838fc7b49,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7cdbe3fc97bf4747a0f09b7fae69c462',protocol=,remote_address_group_id=,remote_group_id=83cd9e5b-9519-48ef-b64b-2d5af35e72c8,remote_ip_prefix=,revision_number=0,security_group_id=83cd9e5b-9519-48ef-b64b-2d5af35e72c8,updated_at=2022-09-25T00:56:35Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:35.321495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5fcc5b1a-dfc0-49d3-865e-e8c01e07e001 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (7152f86c-db14-4980-b054-e2e838fc7b49), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:35.321907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5fcc5b1a-dfc0-49d3-865e-e8c01e07e001 admin admin] Security group rule updated ['83cd9e5b-9519-48ef-b64b-2d5af35e72c8'] Sep 25 00:56:35.322957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5fcc5b1a-dfc0-49d3-865e-e8c01e07e001 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:35Z,description=,direction='egress',ethertype='IPv4',id=764fa5a5-61d5-40da-b0e5-07ab0f4afe16,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7cdbe3fc97bf4747a0f09b7fae69c462',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=83cd9e5b-9519-48ef-b64b-2d5af35e72c8,updated_at=2022-09-25T00:56:35Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:35.324077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5fcc5b1a-dfc0-49d3-865e-e8c01e07e001 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (764fa5a5-61d5-40da-b0e5-07ab0f4afe16), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:35.324592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5fcc5b1a-dfc0-49d3-865e-e8c01e07e001 admin admin] Security group rule updated ['83cd9e5b-9519-48ef-b64b-2d5af35e72c8'] Sep 25 00:56:35.325577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5fcc5b1a-dfc0-49d3-865e-e8c01e07e001 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:35Z,description=,direction='egress',ethertype='IPv6',id=829343d5-8b58-4561-8518-944b40db25b7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7cdbe3fc97bf4747a0f09b7fae69c462',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=83cd9e5b-9519-48ef-b64b-2d5af35e72c8,updated_at=2022-09-25T00:56:35Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:35.326236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5fcc5b1a-dfc0-49d3-865e-e8c01e07e001 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (829343d5-8b58-4561-8518-944b40db25b7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:35.327728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5fcc5b1a-dfc0-49d3-865e-e8c01e07e001 admin admin] Security group rule updated ['83cd9e5b-9519-48ef-b64b-2d5af35e72c8'] Sep 25 00:56:35.328730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5fcc5b1a-dfc0-49d3-865e-e8c01e07e001 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:35Z,description=,direction='ingress',ethertype='IPv4',id=dd9b0a40-0778-403b-83bb-ca22a7b97478,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7cdbe3fc97bf4747a0f09b7fae69c462',protocol=,remote_address_group_id=,remote_group_id=83cd9e5b-9519-48ef-b64b-2d5af35e72c8,remote_ip_prefix=,revision_number=0,security_group_id=83cd9e5b-9519-48ef-b64b-2d5af35e72c8,updated_at=2022-09-25T00:56:35Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:35.329364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5fcc5b1a-dfc0-49d3-865e-e8c01e07e001 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (dd9b0a40-0778-403b-83bb-ca22a7b97478), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:35.329948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5fcc5b1a-dfc0-49d3-865e-e8c01e07e001 admin admin] Security group rule updated ['83cd9e5b-9519-48ef-b64b-2d5af35e72c8'] Sep 25 00:56:35.498984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f23c877b-381c-4b83-b00e-5ba01db6b31e admin admin] Resource SecurityGroup deleted: 83cd9e5b-9519-48ef-b64b-2d5af35e72c8 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:35.499648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f23c877b-381c-4b83-b00e-5ba01db6b31e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (83cd9e5b-9519-48ef-b64b-2d5af35e72c8), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:35.500160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f23c877b-381c-4b83-b00e-5ba01db6b31e admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('83cd9e5b-9519-48ef-b64b-2d5af35e72c8',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:56:35.523887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f23c877b-381c-4b83-b00e-5ba01db6b31e admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('83cd9e5b-9519-48ef-b64b-2d5af35e72c8',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:56:35.525974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f23c877b-381c-4b83-b00e-5ba01db6b31e admin admin] Resource SecurityGroupRule deleted: 7152f86c-db14-4980-b054-e2e838fc7b49 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:35.526415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f23c877b-381c-4b83-b00e-5ba01db6b31e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (7152f86c-db14-4980-b054-e2e838fc7b49), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:35.527188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f23c877b-381c-4b83-b00e-5ba01db6b31e admin admin] Security group rule updated ['83cd9e5b-9519-48ef-b64b-2d5af35e72c8'] Sep 25 00:56:35.529530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f23c877b-381c-4b83-b00e-5ba01db6b31e admin admin] Resource SecurityGroupRule deleted: 764fa5a5-61d5-40da-b0e5-07ab0f4afe16 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:35.529896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f23c877b-381c-4b83-b00e-5ba01db6b31e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (764fa5a5-61d5-40da-b0e5-07ab0f4afe16), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:35.530220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f23c877b-381c-4b83-b00e-5ba01db6b31e admin admin] Security group rule updated ['83cd9e5b-9519-48ef-b64b-2d5af35e72c8'] Sep 25 00:56:35.530599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f23c877b-381c-4b83-b00e-5ba01db6b31e admin admin] Resource SecurityGroupRule deleted: 829343d5-8b58-4561-8518-944b40db25b7 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:35.530942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f23c877b-381c-4b83-b00e-5ba01db6b31e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (829343d5-8b58-4561-8518-944b40db25b7), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:35.531257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f23c877b-381c-4b83-b00e-5ba01db6b31e admin admin] Security group rule updated ['83cd9e5b-9519-48ef-b64b-2d5af35e72c8'] Sep 25 00:56:35.532736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f23c877b-381c-4b83-b00e-5ba01db6b31e admin admin] Resource SecurityGroupRule deleted: dd9b0a40-0778-403b-83bb-ca22a7b97478 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:35.533092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f23c877b-381c-4b83-b00e-5ba01db6b31e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (dd9b0a40-0778-403b-83bb-ca22a7b97478), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:35.533433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f23c877b-381c-4b83-b00e-5ba01db6b31e admin admin] Security group rule updated ['83cd9e5b-9519-48ef-b64b-2d5af35e72c8'] Sep 25 00:56:35.590685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:272 started Sep 25 00:56:35.594608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834ded9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=319000000,duration_sec=558,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:35.595221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:56:35.595867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:272 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:56:35.974748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1aad2cfb-6e82-40ee-90b7-57bb61543020 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:35Z,description='Default security group',id=6c7d0ac5-20be-4f73-8ca7-9a986d5aa066,is_default=True,name='default',project_id='f33e879b885c49fda61a093fdebbd9cd',revision_number=1,rules=[SecurityGroupRule(18864c1e-9795-4c33-9651-a4ad2b62e9e7),SecurityGroupRule(72629c53-1d00-4ebf-bf49-b82a5a7f1416),SecurityGroupRule(85de0e71-8ddf-4d6c-bc6c-2a8e1ec69419),SecurityGroupRule(b39accd0-4ea8-4f8e-8f27-10f88850daa7)],shared=False,stateful=True,updated_at=2022-09-25T00:56:35Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:35.975325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1aad2cfb-6e82-40ee-90b7-57bb61543020 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (6c7d0ac5-20be-4f73-8ca7-9a986d5aa066), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:35.976691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1aad2cfb-6e82-40ee-90b7-57bb61543020 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:35Z,description=,direction='ingress',ethertype='IPv4',id=18864c1e-9795-4c33-9651-a4ad2b62e9e7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f33e879b885c49fda61a093fdebbd9cd',protocol=,remote_address_group_id=,remote_group_id=6c7d0ac5-20be-4f73-8ca7-9a986d5aa066,remote_ip_prefix=,revision_number=0,security_group_id=6c7d0ac5-20be-4f73-8ca7-9a986d5aa066,updated_at=2022-09-25T00:56:35Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:35.977301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1aad2cfb-6e82-40ee-90b7-57bb61543020 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (18864c1e-9795-4c33-9651-a4ad2b62e9e7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:35.978302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1aad2cfb-6e82-40ee-90b7-57bb61543020 admin admin] Security group rule updated ['6c7d0ac5-20be-4f73-8ca7-9a986d5aa066'] Sep 25 00:56:35.979301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1aad2cfb-6e82-40ee-90b7-57bb61543020 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:35Z,description=,direction='egress',ethertype='IPv6',id=72629c53-1d00-4ebf-bf49-b82a5a7f1416,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f33e879b885c49fda61a093fdebbd9cd',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6c7d0ac5-20be-4f73-8ca7-9a986d5aa066,updated_at=2022-09-25T00:56:35Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:35.979765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1aad2cfb-6e82-40ee-90b7-57bb61543020 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (72629c53-1d00-4ebf-bf49-b82a5a7f1416), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:35.980204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1aad2cfb-6e82-40ee-90b7-57bb61543020 admin admin] Security group rule updated ['6c7d0ac5-20be-4f73-8ca7-9a986d5aa066'] Sep 25 00:56:35.981172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1aad2cfb-6e82-40ee-90b7-57bb61543020 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:35Z,description=,direction='egress',ethertype='IPv4',id=85de0e71-8ddf-4d6c-bc6c-2a8e1ec69419,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f33e879b885c49fda61a093fdebbd9cd',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6c7d0ac5-20be-4f73-8ca7-9a986d5aa066,updated_at=2022-09-25T00:56:35Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:35.981689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1aad2cfb-6e82-40ee-90b7-57bb61543020 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (85de0e71-8ddf-4d6c-bc6c-2a8e1ec69419), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:35.982111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1aad2cfb-6e82-40ee-90b7-57bb61543020 admin admin] Security group rule updated ['6c7d0ac5-20be-4f73-8ca7-9a986d5aa066'] Sep 25 00:56:35.983438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1aad2cfb-6e82-40ee-90b7-57bb61543020 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:35Z,description=,direction='ingress',ethertype='IPv6',id=b39accd0-4ea8-4f8e-8f27-10f88850daa7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f33e879b885c49fda61a093fdebbd9cd',protocol=,remote_address_group_id=,remote_group_id=6c7d0ac5-20be-4f73-8ca7-9a986d5aa066,remote_ip_prefix=,revision_number=0,security_group_id=6c7d0ac5-20be-4f73-8ca7-9a986d5aa066,updated_at=2022-09-25T00:56:35Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:35.983985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1aad2cfb-6e82-40ee-90b7-57bb61543020 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (b39accd0-4ea8-4f8e-8f27-10f88850daa7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:35.984326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1aad2cfb-6e82-40ee-90b7-57bb61543020 admin admin] Security group rule updated ['6c7d0ac5-20be-4f73-8ca7-9a986d5aa066'] Sep 25 00:56:36.110220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3738489d-2e69-43e6-96a2-783576f7ee75 admin admin] Resource SecurityGroup deleted: 6c7d0ac5-20be-4f73-8ca7-9a986d5aa066 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:36.110597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3738489d-2e69-43e6-96a2-783576f7ee75 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (6c7d0ac5-20be-4f73-8ca7-9a986d5aa066), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:36.111563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3738489d-2e69-43e6-96a2-783576f7ee75 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('6c7d0ac5-20be-4f73-8ca7-9a986d5aa066',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:56:36.129710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3738489d-2e69-43e6-96a2-783576f7ee75 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('6c7d0ac5-20be-4f73-8ca7-9a986d5aa066',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:56:36.130454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3738489d-2e69-43e6-96a2-783576f7ee75 admin admin] Resource SecurityGroupRule deleted: 18864c1e-9795-4c33-9651-a4ad2b62e9e7 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:36.130913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3738489d-2e69-43e6-96a2-783576f7ee75 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (18864c1e-9795-4c33-9651-a4ad2b62e9e7), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:36.132552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-3738489d-2e69-43e6-96a2-783576f7ee75 admin admin] Security group rule updated ['6c7d0ac5-20be-4f73-8ca7-9a986d5aa066'] Sep 25 00:56:36.135097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3738489d-2e69-43e6-96a2-783576f7ee75 admin admin] Resource SecurityGroupRule deleted: 72629c53-1d00-4ebf-bf49-b82a5a7f1416 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:36.136001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3738489d-2e69-43e6-96a2-783576f7ee75 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (72629c53-1d00-4ebf-bf49-b82a5a7f1416), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:36.140871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-3738489d-2e69-43e6-96a2-783576f7ee75 admin admin] Security group rule updated ['6c7d0ac5-20be-4f73-8ca7-9a986d5aa066'] Sep 25 00:56:36.141665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3738489d-2e69-43e6-96a2-783576f7ee75 admin admin] Resource SecurityGroupRule deleted: 85de0e71-8ddf-4d6c-bc6c-2a8e1ec69419 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:36.142131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3738489d-2e69-43e6-96a2-783576f7ee75 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (85de0e71-8ddf-4d6c-bc6c-2a8e1ec69419), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:36.142547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-3738489d-2e69-43e6-96a2-783576f7ee75 admin admin] Security group rule updated ['6c7d0ac5-20be-4f73-8ca7-9a986d5aa066'] Sep 25 00:56:36.143115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3738489d-2e69-43e6-96a2-783576f7ee75 admin admin] Resource SecurityGroupRule deleted: b39accd0-4ea8-4f8e-8f27-10f88850daa7 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:36.143782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3738489d-2e69-43e6-96a2-783576f7ee75 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (b39accd0-4ea8-4f8e-8f27-10f88850daa7), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:36.144337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-3738489d-2e69-43e6-96a2-783576f7ee75 admin admin] Security group rule updated ['6c7d0ac5-20be-4f73-8ca7-9a986d5aa066'] Sep 25 00:56:36.761249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5c401f7b-7bc3-4651-a91d-179d6fe3255a admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:36Z,description='Default security group',id=f3bde60e-ac9e-461d-8fb0-71b9aa84971e,is_default=True,name='default',project_id='b5d8eb9c319b468d97a4dec4561eb69d',revision_number=1,rules=[SecurityGroupRule(54277be1-2b20-4166-ba5e-04ab71a150a8),SecurityGroupRule(b14f0685-e93e-4547-b739-f57e1577c512),SecurityGroupRule(b5e4aef9-4da7-421a-a28f-a72ee61ad198),SecurityGroupRule(fdf46204-e334-40ef-82d4-1cb45fefaf78)],shared=False,stateful=True,updated_at=2022-09-25T00:56:36Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:36.761861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5c401f7b-7bc3-4651-a91d-179d6fe3255a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (f3bde60e-ac9e-461d-8fb0-71b9aa84971e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:36.762326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5c401f7b-7bc3-4651-a91d-179d6fe3255a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:36Z,description=,direction='egress',ethertype='IPv6',id=54277be1-2b20-4166-ba5e-04ab71a150a8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b5d8eb9c319b468d97a4dec4561eb69d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f3bde60e-ac9e-461d-8fb0-71b9aa84971e,updated_at=2022-09-25T00:56:36Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:36.762689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5c401f7b-7bc3-4651-a91d-179d6fe3255a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (54277be1-2b20-4166-ba5e-04ab71a150a8), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:36.763027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5c401f7b-7bc3-4651-a91d-179d6fe3255a admin admin] Security group rule updated ['f3bde60e-ac9e-461d-8fb0-71b9aa84971e'] Sep 25 00:56:36.764455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5c401f7b-7bc3-4651-a91d-179d6fe3255a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:36Z,description=,direction='ingress',ethertype='IPv4',id=b14f0685-e93e-4547-b739-f57e1577c512,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b5d8eb9c319b468d97a4dec4561eb69d',protocol=,remote_address_group_id=,remote_group_id=f3bde60e-ac9e-461d-8fb0-71b9aa84971e,remote_ip_prefix=,revision_number=0,security_group_id=f3bde60e-ac9e-461d-8fb0-71b9aa84971e,updated_at=2022-09-25T00:56:36Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:36.765040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5c401f7b-7bc3-4651-a91d-179d6fe3255a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (b14f0685-e93e-4547-b739-f57e1577c512), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:36.765765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5c401f7b-7bc3-4651-a91d-179d6fe3255a admin admin] Security group rule updated ['f3bde60e-ac9e-461d-8fb0-71b9aa84971e'] Sep 25 00:56:36.777451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5c401f7b-7bc3-4651-a91d-179d6fe3255a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:36Z,description=,direction='ingress',ethertype='IPv6',id=b5e4aef9-4da7-421a-a28f-a72ee61ad198,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b5d8eb9c319b468d97a4dec4561eb69d',protocol=,remote_address_group_id=,remote_group_id=f3bde60e-ac9e-461d-8fb0-71b9aa84971e,remote_ip_prefix=,revision_number=0,security_group_id=f3bde60e-ac9e-461d-8fb0-71b9aa84971e,updated_at=2022-09-25T00:56:36Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:36.777451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5c401f7b-7bc3-4651-a91d-179d6fe3255a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (b5e4aef9-4da7-421a-a28f-a72ee61ad198), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:36.777451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5c401f7b-7bc3-4651-a91d-179d6fe3255a admin admin] Security group rule updated ['f3bde60e-ac9e-461d-8fb0-71b9aa84971e'] Sep 25 00:56:36.777901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5c401f7b-7bc3-4651-a91d-179d6fe3255a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:36Z,description=,direction='egress',ethertype='IPv4',id=fdf46204-e334-40ef-82d4-1cb45fefaf78,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b5d8eb9c319b468d97a4dec4561eb69d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f3bde60e-ac9e-461d-8fb0-71b9aa84971e,updated_at=2022-09-25T00:56:36Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:36.777901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5c401f7b-7bc3-4651-a91d-179d6fe3255a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (fdf46204-e334-40ef-82d4-1cb45fefaf78), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:36.777901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5c401f7b-7bc3-4651-a91d-179d6fe3255a admin admin] Security group rule updated ['f3bde60e-ac9e-461d-8fb0-71b9aa84971e'] Sep 25 00:56:36.946062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fdf83cd1-8163-4021-b606-cee17ede51c7 admin admin] Resource SecurityGroup deleted: f3bde60e-ac9e-461d-8fb0-71b9aa84971e {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:36.946530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fdf83cd1-8163-4021-b606-cee17ede51c7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (f3bde60e-ac9e-461d-8fb0-71b9aa84971e), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:36.946995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdf83cd1-8163-4021-b606-cee17ede51c7 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('f3bde60e-ac9e-461d-8fb0-71b9aa84971e',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:56:36.961133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fdf83cd1-8163-4021-b606-cee17ede51c7 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('f3bde60e-ac9e-461d-8fb0-71b9aa84971e',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:56:36.961626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fdf83cd1-8163-4021-b606-cee17ede51c7 admin admin] Resource SecurityGroupRule deleted: 54277be1-2b20-4166-ba5e-04ab71a150a8 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:36.961995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fdf83cd1-8163-4021-b606-cee17ede51c7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (54277be1-2b20-4166-ba5e-04ab71a150a8), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:36.962331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-fdf83cd1-8163-4021-b606-cee17ede51c7 admin admin] Security group rule updated ['f3bde60e-ac9e-461d-8fb0-71b9aa84971e'] Sep 25 00:56:36.962726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fdf83cd1-8163-4021-b606-cee17ede51c7 admin admin] Resource SecurityGroupRule deleted: b14f0685-e93e-4547-b739-f57e1577c512 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:36.963068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fdf83cd1-8163-4021-b606-cee17ede51c7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (b14f0685-e93e-4547-b739-f57e1577c512), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:36.963383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-fdf83cd1-8163-4021-b606-cee17ede51c7 admin admin] Security group rule updated ['f3bde60e-ac9e-461d-8fb0-71b9aa84971e'] Sep 25 00:56:36.963753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fdf83cd1-8163-4021-b606-cee17ede51c7 admin admin] Resource SecurityGroupRule deleted: b5e4aef9-4da7-421a-a28f-a72ee61ad198 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:36.964224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fdf83cd1-8163-4021-b606-cee17ede51c7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (b5e4aef9-4da7-421a-a28f-a72ee61ad198), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:36.964546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-fdf83cd1-8163-4021-b606-cee17ede51c7 admin admin] Security group rule updated ['f3bde60e-ac9e-461d-8fb0-71b9aa84971e'] Sep 25 00:56:36.965005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fdf83cd1-8163-4021-b606-cee17ede51c7 admin admin] Resource SecurityGroupRule deleted: fdf46204-e334-40ef-82d4-1cb45fefaf78 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:36.965376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fdf83cd1-8163-4021-b606-cee17ede51c7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (fdf46204-e334-40ef-82d4-1cb45fefaf78), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:36.965691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-fdf83cd1-8163-4021-b606-cee17ede51c7 admin admin] Security group rule updated ['f3bde60e-ac9e-461d-8fb0-71b9aa84971e'] Sep 25 00:56:37.592232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:273 started Sep 25 00:56:37.596157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dedb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=321000000,duration_sec=560,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:37.597694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:56:37.598435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:273 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 00:56:38.985613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 0b0017e5-0afb-4334-8450-1d4303b0d473 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:38.987117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (0b0017e5-0afb-4334-8450-1d4303b0d473), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:39.504141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 344eed51-ca03-4da0-b7a1-415ff8227472 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:39.504736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (344eed51-ca03-4da0-b7a1-415ff8227472), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:39.593649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:274 started Sep 25 00:56:39.597852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dedd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=322000000,duration_sec=562,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:39.598821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:56:39.599554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:274 - starting polling. Elapsed:0.006 Sep 25 00:56:39.604006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:39.607860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:274 - port information retrieved. Elapsed:0.014 Sep 25 00:56:39.608455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:274 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Sep 25 00:56:41.208755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 1f1b4ee1-4f64-49a9-bb20-210b866dfbd5 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:41.210992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (1f1b4ee1-4f64-49a9-bb20-210b866dfbd5), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:41.595070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:275 started Sep 25 00:56:41.598504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dedf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=324000000,duration_sec=564,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:41.599268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:56:41.599649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:275 - starting polling. Elapsed:0.005 Sep 25 00:56:41.603034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:41.606230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:275 - port information retrieved. Elapsed:0.011 Sep 25 00:56:41.606572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:275 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 25 00:56:42.080481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 0b0017e5-0afb-4334-8450-1d4303b0d473 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:42.080865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (0b0017e5-0afb-4334-8450-1d4303b0d473), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:42.304990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 344eed51-ca03-4da0-b7a1-415ff8227472 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:42.305604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (344eed51-ca03-4da0-b7a1-415ff8227472), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:43.595869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:276 started Sep 25 00:56:43.598349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dee1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=324000000,duration_sec=566,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:43.598920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:56:43.599255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:276 - starting polling. Elapsed:0.004 Sep 25 00:56:43.602198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:43.605311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:276 - port information retrieved. Elapsed:0.010 Sep 25 00:56:43.605648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:276 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 25 00:56:45.599241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:277 started Sep 25 00:56:45.608998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dee3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=330000000,duration_sec=568,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:45.610008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:56:45.610901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:277 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 25 00:56:46.291725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1c059f10-0407-43e3-b627-c598bc4d047e service neutron] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:46Z,description='Default security group',id=bf0496cb-bcc8-4d16-b6a6-d352fc9e1acf,is_default=True,name='default',project_id='9db0fd07fc494203b2ada13f3cd046d3',revision_number=1,rules=[SecurityGroupRule(62a119fa-deee-4ec8-8d22-96d422639902),SecurityGroupRule(afac8a6e-ea80-4923-8289-98620fa6dbe7),SecurityGroupRule(b162cef3-2198-4759-beb5-43f5944cdde3),SecurityGroupRule(eb37aa0f-fed1-4fd8-8a77-17804e7d9ee8)],shared=False,stateful=True,updated_at=2022-09-25T00:56:46Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:46.292197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1c059f10-0407-43e3-b627-c598bc4d047e service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (bf0496cb-bcc8-4d16-b6a6-d352fc9e1acf), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:46.293103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1c059f10-0407-43e3-b627-c598bc4d047e service neutron] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:46Z,description=,direction='egress',ethertype='IPv4',id=62a119fa-deee-4ec8-8d22-96d422639902,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9db0fd07fc494203b2ada13f3cd046d3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=bf0496cb-bcc8-4d16-b6a6-d352fc9e1acf,updated_at=2022-09-25T00:56:46Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:46.293619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1c059f10-0407-43e3-b627-c598bc4d047e service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (62a119fa-deee-4ec8-8d22-96d422639902), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:46.294028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1c059f10-0407-43e3-b627-c598bc4d047e service neutron] Security group rule updated ['bf0496cb-bcc8-4d16-b6a6-d352fc9e1acf'] Sep 25 00:56:46.294772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1c059f10-0407-43e3-b627-c598bc4d047e service neutron] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:46Z,description=,direction='egress',ethertype='IPv6',id=afac8a6e-ea80-4923-8289-98620fa6dbe7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9db0fd07fc494203b2ada13f3cd046d3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=bf0496cb-bcc8-4d16-b6a6-d352fc9e1acf,updated_at=2022-09-25T00:56:46Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:46.295245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1c059f10-0407-43e3-b627-c598bc4d047e service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (afac8a6e-ea80-4923-8289-98620fa6dbe7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:46.295643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1c059f10-0407-43e3-b627-c598bc4d047e service neutron] Security group rule updated ['bf0496cb-bcc8-4d16-b6a6-d352fc9e1acf'] Sep 25 00:56:46.296380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1c059f10-0407-43e3-b627-c598bc4d047e service neutron] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:46Z,description=,direction='ingress',ethertype='IPv4',id=b162cef3-2198-4759-beb5-43f5944cdde3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9db0fd07fc494203b2ada13f3cd046d3',protocol=,remote_address_group_id=,remote_group_id=bf0496cb-bcc8-4d16-b6a6-d352fc9e1acf,remote_ip_prefix=,revision_number=0,security_group_id=bf0496cb-bcc8-4d16-b6a6-d352fc9e1acf,updated_at=2022-09-25T00:56:46Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:46.298464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1c059f10-0407-43e3-b627-c598bc4d047e service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (b162cef3-2198-4759-beb5-43f5944cdde3), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:46.298962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1c059f10-0407-43e3-b627-c598bc4d047e service neutron] Security group rule updated ['bf0496cb-bcc8-4d16-b6a6-d352fc9e1acf'] Sep 25 00:56:46.299822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1c059f10-0407-43e3-b627-c598bc4d047e service neutron] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:46Z,description=,direction='ingress',ethertype='IPv6',id=eb37aa0f-fed1-4fd8-8a77-17804e7d9ee8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9db0fd07fc494203b2ada13f3cd046d3',protocol=,remote_address_group_id=,remote_group_id=bf0496cb-bcc8-4d16-b6a6-d352fc9e1acf,remote_ip_prefix=,revision_number=0,security_group_id=bf0496cb-bcc8-4d16-b6a6-d352fc9e1acf,updated_at=2022-09-25T00:56:46Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:46.301050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1c059f10-0407-43e3-b627-c598bc4d047e service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (eb37aa0f-fed1-4fd8-8a77-17804e7d9ee8), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:46.301690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1c059f10-0407-43e3-b627-c598bc4d047e service neutron] Security group rule updated ['bf0496cb-bcc8-4d16-b6a6-d352fc9e1acf'] Sep 25 00:56:46.378770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-92bf6157-b1ad-486c-b949-1590a170247e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:46Z,description='Default security group',id=daa0c5d4-c196-4d81-adcc-a7449c312c9f,is_default=True,name='default',project_id='5154c6a303bf4de9a8b2a0335c442ba3',revision_number=1,rules=[SecurityGroupRule(350e55ed-6c16-4837-be4e-eb60da258aac),SecurityGroupRule(6be75b12-a383-4314-8a07-5602fd7df54e),SecurityGroupRule(b1ce0f8f-fe04-4afd-961d-74380669b3a8),SecurityGroupRule(d99b9ab9-b3cb-4e13-87bc-bab7146010ab)],shared=False,stateful=True,updated_at=2022-09-25T00:56:46Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:46.379583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-92bf6157-b1ad-486c-b949-1590a170247e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (daa0c5d4-c196-4d81-adcc-a7449c312c9f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:46.380516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-92bf6157-b1ad-486c-b949-1590a170247e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:46Z,description=,direction='egress',ethertype='IPv4',id=350e55ed-6c16-4837-be4e-eb60da258aac,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5154c6a303bf4de9a8b2a0335c442ba3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=daa0c5d4-c196-4d81-adcc-a7449c312c9f,updated_at=2022-09-25T00:56:46Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:46.381696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-92bf6157-b1ad-486c-b949-1590a170247e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (350e55ed-6c16-4837-be4e-eb60da258aac), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:46.382252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-92bf6157-b1ad-486c-b949-1590a170247e admin admin] Security group rule updated ['daa0c5d4-c196-4d81-adcc-a7449c312c9f'] Sep 25 00:56:46.383325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-92bf6157-b1ad-486c-b949-1590a170247e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:46Z,description=,direction='ingress',ethertype='IPv6',id=6be75b12-a383-4314-8a07-5602fd7df54e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5154c6a303bf4de9a8b2a0335c442ba3',protocol=,remote_address_group_id=,remote_group_id=daa0c5d4-c196-4d81-adcc-a7449c312c9f,remote_ip_prefix=,revision_number=0,security_group_id=daa0c5d4-c196-4d81-adcc-a7449c312c9f,updated_at=2022-09-25T00:56:46Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:46.384186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-92bf6157-b1ad-486c-b949-1590a170247e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (6be75b12-a383-4314-8a07-5602fd7df54e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:46.384628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-92bf6157-b1ad-486c-b949-1590a170247e admin admin] Security group rule updated ['daa0c5d4-c196-4d81-adcc-a7449c312c9f'] Sep 25 00:56:46.385497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-92bf6157-b1ad-486c-b949-1590a170247e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:46Z,description=,direction='egress',ethertype='IPv6',id=b1ce0f8f-fe04-4afd-961d-74380669b3a8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5154c6a303bf4de9a8b2a0335c442ba3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=daa0c5d4-c196-4d81-adcc-a7449c312c9f,updated_at=2022-09-25T00:56:46Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:46.385852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-92bf6157-b1ad-486c-b949-1590a170247e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (b1ce0f8f-fe04-4afd-961d-74380669b3a8), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:46.386338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-92bf6157-b1ad-486c-b949-1590a170247e admin admin] Security group rule updated ['daa0c5d4-c196-4d81-adcc-a7449c312c9f'] Sep 25 00:56:46.388287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-92bf6157-b1ad-486c-b949-1590a170247e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:46Z,description=,direction='ingress',ethertype='IPv4',id=d99b9ab9-b3cb-4e13-87bc-bab7146010ab,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5154c6a303bf4de9a8b2a0335c442ba3',protocol=,remote_address_group_id=,remote_group_id=daa0c5d4-c196-4d81-adcc-a7449c312c9f,remote_ip_prefix=,revision_number=0,security_group_id=daa0c5d4-c196-4d81-adcc-a7449c312c9f,updated_at=2022-09-25T00:56:46Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:46.389103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-92bf6157-b1ad-486c-b949-1590a170247e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (d99b9ab9-b3cb-4e13-87bc-bab7146010ab), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:46.389889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-92bf6157-b1ad-486c-b949-1590a170247e admin admin] Security group rule updated ['daa0c5d4-c196-4d81-adcc-a7449c312c9f'] Sep 25 00:56:46.540788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f7146e80-a7c0-4949-85ae-ee2ae8428696 admin admin] Resource SecurityGroup deleted: daa0c5d4-c196-4d81-adcc-a7449c312c9f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:46.541437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f7146e80-a7c0-4949-85ae-ee2ae8428696 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (daa0c5d4-c196-4d81-adcc-a7449c312c9f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:46.541933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7146e80-a7c0-4949-85ae-ee2ae8428696 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('daa0c5d4-c196-4d81-adcc-a7449c312c9f',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:56:46.560985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f7146e80-a7c0-4949-85ae-ee2ae8428696 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('daa0c5d4-c196-4d81-adcc-a7449c312c9f',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:56:46.563125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f7146e80-a7c0-4949-85ae-ee2ae8428696 admin admin] Resource SecurityGroupRule deleted: 350e55ed-6c16-4837-be4e-eb60da258aac {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:46.563630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f7146e80-a7c0-4949-85ae-ee2ae8428696 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (350e55ed-6c16-4837-be4e-eb60da258aac), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:46.564474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f7146e80-a7c0-4949-85ae-ee2ae8428696 admin admin] Security group rule updated ['daa0c5d4-c196-4d81-adcc-a7449c312c9f'] Sep 25 00:56:46.564922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f7146e80-a7c0-4949-85ae-ee2ae8428696 admin admin] Resource SecurityGroupRule deleted: 6be75b12-a383-4314-8a07-5602fd7df54e {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:46.565337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f7146e80-a7c0-4949-85ae-ee2ae8428696 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (6be75b12-a383-4314-8a07-5602fd7df54e), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:46.567702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f7146e80-a7c0-4949-85ae-ee2ae8428696 admin admin] Security group rule updated ['daa0c5d4-c196-4d81-adcc-a7449c312c9f'] Sep 25 00:56:46.568099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f7146e80-a7c0-4949-85ae-ee2ae8428696 admin admin] Resource SecurityGroupRule deleted: b1ce0f8f-fe04-4afd-961d-74380669b3a8 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:46.570755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f7146e80-a7c0-4949-85ae-ee2ae8428696 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (b1ce0f8f-fe04-4afd-961d-74380669b3a8), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:46.571139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f7146e80-a7c0-4949-85ae-ee2ae8428696 admin admin] Security group rule updated ['daa0c5d4-c196-4d81-adcc-a7449c312c9f'] Sep 25 00:56:46.573513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f7146e80-a7c0-4949-85ae-ee2ae8428696 admin admin] Resource SecurityGroupRule deleted: d99b9ab9-b3cb-4e13-87bc-bab7146010ab {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:46.573998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f7146e80-a7c0-4949-85ae-ee2ae8428696 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (d99b9ab9-b3cb-4e13-87bc-bab7146010ab), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:46.574419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f7146e80-a7c0-4949-85ae-ee2ae8428696 admin admin] Security group rule updated ['daa0c5d4-c196-4d81-adcc-a7449c312c9f'] Sep 25 00:56:46.916865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-36910790-9cd5-49c2-a972-351cca7bf5a8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:46Z,description='Default security group',id=0be558a0-f01d-43c7-8fa1-8adc29b5584d,is_default=True,name='default',project_id='7c9056114d8848b190a75c2de6727864',revision_number=1,rules=[SecurityGroupRule(6328763c-9c00-4b0c-89f6-bec7ee3441ab),SecurityGroupRule(68c0fffa-769a-4d44-85c9-623e0c8f9665),SecurityGroupRule(9f646d83-184c-460b-b199-888c5688e41d),SecurityGroupRule(f863ead6-5561-40e2-b888-c1cdc78eb97c)],shared=False,stateful=True,updated_at=2022-09-25T00:56:46Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:46.918284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-36910790-9cd5-49c2-a972-351cca7bf5a8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (0be558a0-f01d-43c7-8fa1-8adc29b5584d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:46.920917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-36910790-9cd5-49c2-a972-351cca7bf5a8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:46Z,description=,direction='egress',ethertype='IPv6',id=6328763c-9c00-4b0c-89f6-bec7ee3441ab,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7c9056114d8848b190a75c2de6727864',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0be558a0-f01d-43c7-8fa1-8adc29b5584d,updated_at=2022-09-25T00:56:46Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:46.921618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-36910790-9cd5-49c2-a972-351cca7bf5a8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (6328763c-9c00-4b0c-89f6-bec7ee3441ab), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:46.923979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-36910790-9cd5-49c2-a972-351cca7bf5a8 admin admin] Security group rule updated ['0be558a0-f01d-43c7-8fa1-8adc29b5584d'] Sep 25 00:56:46.925418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-36910790-9cd5-49c2-a972-351cca7bf5a8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:46Z,description=,direction='ingress',ethertype='IPv4',id=68c0fffa-769a-4d44-85c9-623e0c8f9665,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7c9056114d8848b190a75c2de6727864',protocol=,remote_address_group_id=,remote_group_id=0be558a0-f01d-43c7-8fa1-8adc29b5584d,remote_ip_prefix=,revision_number=0,security_group_id=0be558a0-f01d-43c7-8fa1-8adc29b5584d,updated_at=2022-09-25T00:56:46Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:46.927546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-36910790-9cd5-49c2-a972-351cca7bf5a8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (68c0fffa-769a-4d44-85c9-623e0c8f9665), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:46.930766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-36910790-9cd5-49c2-a972-351cca7bf5a8 admin admin] Security group rule updated ['0be558a0-f01d-43c7-8fa1-8adc29b5584d'] Sep 25 00:56:46.933691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-36910790-9cd5-49c2-a972-351cca7bf5a8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:46Z,description=,direction='egress',ethertype='IPv4',id=9f646d83-184c-460b-b199-888c5688e41d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7c9056114d8848b190a75c2de6727864',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0be558a0-f01d-43c7-8fa1-8adc29b5584d,updated_at=2022-09-25T00:56:46Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:46.934627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-36910790-9cd5-49c2-a972-351cca7bf5a8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (9f646d83-184c-460b-b199-888c5688e41d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:46.935385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-36910790-9cd5-49c2-a972-351cca7bf5a8 admin admin] Security group rule updated ['0be558a0-f01d-43c7-8fa1-8adc29b5584d'] Sep 25 00:56:46.941103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-36910790-9cd5-49c2-a972-351cca7bf5a8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:46Z,description=,direction='ingress',ethertype='IPv6',id=f863ead6-5561-40e2-b888-c1cdc78eb97c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7c9056114d8848b190a75c2de6727864',protocol=,remote_address_group_id=,remote_group_id=0be558a0-f01d-43c7-8fa1-8adc29b5584d,remote_ip_prefix=,revision_number=0,security_group_id=0be558a0-f01d-43c7-8fa1-8adc29b5584d,updated_at=2022-09-25T00:56:46Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:46.941769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-36910790-9cd5-49c2-a972-351cca7bf5a8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f863ead6-5561-40e2-b888-c1cdc78eb97c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:46.944853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-36910790-9cd5-49c2-a972-351cca7bf5a8 admin admin] Security group rule updated ['0be558a0-f01d-43c7-8fa1-8adc29b5584d'] Sep 25 00:56:47.211721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 96168749-3e0f-462f-9aed-adacd4fb28c0 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:47.211926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (96168749-3e0f-462f-9aed-adacd4fb28c0), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:47.271939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b19a1437-f5f4-4fd4-8ad2-fc64c49a61e9 admin admin] Resource SecurityGroup deleted: 0be558a0-f01d-43c7-8fa1-8adc29b5584d {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:47.272787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b19a1437-f5f4-4fd4-8ad2-fc64c49a61e9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (0be558a0-f01d-43c7-8fa1-8adc29b5584d), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:47.273534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b19a1437-f5f4-4fd4-8ad2-fc64c49a61e9 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0be558a0-f01d-43c7-8fa1-8adc29b5584d',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:56:47.315971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 1f1b4ee1-4f64-49a9-bb20-210b866dfbd5 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:47.327932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (1f1b4ee1-4f64-49a9-bb20-210b866dfbd5), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:47.352061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b19a1437-f5f4-4fd4-8ad2-fc64c49a61e9 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0be558a0-f01d-43c7-8fa1-8adc29b5584d',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:56:47.355923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b19a1437-f5f4-4fd4-8ad2-fc64c49a61e9 admin admin] Resource SecurityGroupRule deleted: 6328763c-9c00-4b0c-89f6-bec7ee3441ab {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:47.356552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b19a1437-f5f4-4fd4-8ad2-fc64c49a61e9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (6328763c-9c00-4b0c-89f6-bec7ee3441ab), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:47.361379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b19a1437-f5f4-4fd4-8ad2-fc64c49a61e9 admin admin] Security group rule updated ['0be558a0-f01d-43c7-8fa1-8adc29b5584d'] Sep 25 00:56:47.362154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b19a1437-f5f4-4fd4-8ad2-fc64c49a61e9 admin admin] Resource SecurityGroupRule deleted: 68c0fffa-769a-4d44-85c9-623e0c8f9665 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:47.362761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b19a1437-f5f4-4fd4-8ad2-fc64c49a61e9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (68c0fffa-769a-4d44-85c9-623e0c8f9665), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:47.363545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b19a1437-f5f4-4fd4-8ad2-fc64c49a61e9 admin admin] Security group rule updated ['0be558a0-f01d-43c7-8fa1-8adc29b5584d'] Sep 25 00:56:47.367558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b19a1437-f5f4-4fd4-8ad2-fc64c49a61e9 admin admin] Resource SecurityGroupRule deleted: 9f646d83-184c-460b-b199-888c5688e41d {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:47.368261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b19a1437-f5f4-4fd4-8ad2-fc64c49a61e9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (9f646d83-184c-460b-b199-888c5688e41d), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:47.368813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b19a1437-f5f4-4fd4-8ad2-fc64c49a61e9 admin admin] Security group rule updated ['0be558a0-f01d-43c7-8fa1-8adc29b5584d'] Sep 25 00:56:47.380715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b19a1437-f5f4-4fd4-8ad2-fc64c49a61e9 admin admin] Resource SecurityGroupRule deleted: f863ead6-5561-40e2-b888-c1cdc78eb97c {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:47.381371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b19a1437-f5f4-4fd4-8ad2-fc64c49a61e9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f863ead6-5561-40e2-b888-c1cdc78eb97c), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:47.381928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b19a1437-f5f4-4fd4-8ad2-fc64c49a61e9 admin admin] Security group rule updated ['0be558a0-f01d-43c7-8fa1-8adc29b5584d'] Sep 25 00:56:47.506329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-80719719-da1a-4e41-8930-a91f438a0c94 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:47Z,description='Default security group',id=e34e1761-3f11-499c-ba3d-66373d4d4925,is_default=True,name='default',project_id='94d5d7bf642f4ea38e7ae27d971b0d0c',revision_number=1,rules=[SecurityGroupRule(0e618075-359a-4ea6-a59a-744aff3d553e),SecurityGroupRule(3ef99e6d-7095-4922-bd5e-42b074b73110),SecurityGroupRule(53f3748a-7658-4591-9eaa-4aac2c73cf0f),SecurityGroupRule(a02aa485-8bb6-49f2-95ae-d771db24e734)],shared=False,stateful=True,updated_at=2022-09-25T00:56:47Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:47.506718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-80719719-da1a-4e41-8930-a91f438a0c94 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (e34e1761-3f11-499c-ba3d-66373d4d4925), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:47.507358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-80719719-da1a-4e41-8930-a91f438a0c94 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:47Z,description=,direction='egress',ethertype='IPv4',id=0e618075-359a-4ea6-a59a-744aff3d553e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='94d5d7bf642f4ea38e7ae27d971b0d0c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e34e1761-3f11-499c-ba3d-66373d4d4925,updated_at=2022-09-25T00:56:47Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:47.507828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-80719719-da1a-4e41-8930-a91f438a0c94 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (0e618075-359a-4ea6-a59a-744aff3d553e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:47.508052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-80719719-da1a-4e41-8930-a91f438a0c94 admin admin] Security group rule updated ['e34e1761-3f11-499c-ba3d-66373d4d4925'] Sep 25 00:56:47.508767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-80719719-da1a-4e41-8930-a91f438a0c94 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:47Z,description=,direction='ingress',ethertype='IPv6',id=3ef99e6d-7095-4922-bd5e-42b074b73110,normalized_cidr=None,port_range_max=,port_range_min=,project_id='94d5d7bf642f4ea38e7ae27d971b0d0c',protocol=,remote_address_group_id=,remote_group_id=e34e1761-3f11-499c-ba3d-66373d4d4925,remote_ip_prefix=,revision_number=0,security_group_id=e34e1761-3f11-499c-ba3d-66373d4d4925,updated_at=2022-09-25T00:56:47Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:47.509081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-80719719-da1a-4e41-8930-a91f438a0c94 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (3ef99e6d-7095-4922-bd5e-42b074b73110), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:47.509677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-80719719-da1a-4e41-8930-a91f438a0c94 admin admin] Security group rule updated ['e34e1761-3f11-499c-ba3d-66373d4d4925'] Sep 25 00:56:47.510498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-80719719-da1a-4e41-8930-a91f438a0c94 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:47Z,description=,direction='ingress',ethertype='IPv4',id=53f3748a-7658-4591-9eaa-4aac2c73cf0f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='94d5d7bf642f4ea38e7ae27d971b0d0c',protocol=,remote_address_group_id=,remote_group_id=e34e1761-3f11-499c-ba3d-66373d4d4925,remote_ip_prefix=,revision_number=0,security_group_id=e34e1761-3f11-499c-ba3d-66373d4d4925,updated_at=2022-09-25T00:56:47Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:47.511046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-80719719-da1a-4e41-8930-a91f438a0c94 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (53f3748a-7658-4591-9eaa-4aac2c73cf0f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:47.511541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-80719719-da1a-4e41-8930-a91f438a0c94 admin admin] Security group rule updated ['e34e1761-3f11-499c-ba3d-66373d4d4925'] Sep 25 00:56:47.513966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-80719719-da1a-4e41-8930-a91f438a0c94 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:47Z,description=,direction='egress',ethertype='IPv6',id=a02aa485-8bb6-49f2-95ae-d771db24e734,normalized_cidr=None,port_range_max=,port_range_min=,project_id='94d5d7bf642f4ea38e7ae27d971b0d0c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e34e1761-3f11-499c-ba3d-66373d4d4925,updated_at=2022-09-25T00:56:47Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:47.515749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-80719719-da1a-4e41-8930-a91f438a0c94 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (a02aa485-8bb6-49f2-95ae-d771db24e734), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:47.516248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-80719719-da1a-4e41-8930-a91f438a0c94 admin admin] Security group rule updated ['e34e1761-3f11-499c-ba3d-66373d4d4925'] Sep 25 00:56:47.600731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:278 started Sep 25 00:56:47.604808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dee5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=330000000,duration_sec=570,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:47.606192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:56:47.606615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:278 - starting polling. Elapsed:0.007 Sep 25 00:56:47.610024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:47.629484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:278 - port information retrieved. Elapsed:0.030 Sep 25 00:56:47.633478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:278 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.030 Sep 25 00:56:47.796776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5c09f6ec-cac7-4139-9e17-3204d363b614 admin admin] Resource SecurityGroup deleted: e34e1761-3f11-499c-ba3d-66373d4d4925 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:47.797401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5c09f6ec-cac7-4139-9e17-3204d363b614 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (e34e1761-3f11-499c-ba3d-66373d4d4925), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:47.798092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c09f6ec-cac7-4139-9e17-3204d363b614 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e34e1761-3f11-499c-ba3d-66373d4d4925',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:56:47.951694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 9618d105-fdf7-4a07-9a29-e94ba03b6c41 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:47.957633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (9618d105-fdf7-4a07-9a29-e94ba03b6c41), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:47.968397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5c09f6ec-cac7-4139-9e17-3204d363b614 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e34e1761-3f11-499c-ba3d-66373d4d4925',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:56:47.969654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5c09f6ec-cac7-4139-9e17-3204d363b614 admin admin] Resource SecurityGroupRule deleted: 0e618075-359a-4ea6-a59a-744aff3d553e {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:47.970278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5c09f6ec-cac7-4139-9e17-3204d363b614 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (0e618075-359a-4ea6-a59a-744aff3d553e), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:47.970862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5c09f6ec-cac7-4139-9e17-3204d363b614 admin admin] Security group rule updated ['e34e1761-3f11-499c-ba3d-66373d4d4925'] Sep 25 00:56:47.971358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5c09f6ec-cac7-4139-9e17-3204d363b614 admin admin] Resource SecurityGroupRule deleted: 3ef99e6d-7095-4922-bd5e-42b074b73110 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:47.971807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5c09f6ec-cac7-4139-9e17-3204d363b614 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (3ef99e6d-7095-4922-bd5e-42b074b73110), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:47.972333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5c09f6ec-cac7-4139-9e17-3204d363b614 admin admin] Security group rule updated ['e34e1761-3f11-499c-ba3d-66373d4d4925'] Sep 25 00:56:47.972814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5c09f6ec-cac7-4139-9e17-3204d363b614 admin admin] Resource SecurityGroupRule deleted: 53f3748a-7658-4591-9eaa-4aac2c73cf0f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:47.973397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5c09f6ec-cac7-4139-9e17-3204d363b614 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (53f3748a-7658-4591-9eaa-4aac2c73cf0f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:47.973936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5c09f6ec-cac7-4139-9e17-3204d363b614 admin admin] Security group rule updated ['e34e1761-3f11-499c-ba3d-66373d4d4925'] Sep 25 00:56:47.974426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5c09f6ec-cac7-4139-9e17-3204d363b614 admin admin] Resource SecurityGroupRule deleted: a02aa485-8bb6-49f2-95ae-d771db24e734 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:47.975764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5c09f6ec-cac7-4139-9e17-3204d363b614 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (a02aa485-8bb6-49f2-95ae-d771db24e734), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:47.976345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5c09f6ec-cac7-4139-9e17-3204d363b614 admin admin] Security group rule updated ['e34e1761-3f11-499c-ba3d-66373d4d4925'] Sep 25 00:56:48.217374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ca9c0a34-70f1-4463-91c1-f965ad880f5d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:48Z,description='Default security group',id=b05a07af-8842-4298-afaf-fd2a86db13a8,is_default=True,name='default',project_id='d1d652f52ade4b488b76564ecb719bd5',revision_number=1,rules=[SecurityGroupRule(20b8e6a0-2fd0-41bc-9e4f-40835a7fb4a1),SecurityGroupRule(30854e74-6158-4fbf-8354-a49c618bdfd5),SecurityGroupRule(cfa07352-e2e3-40bc-a5c8-5f19a746ddf0),SecurityGroupRule(f660d71b-5b1a-457f-9358-3c6c630553d4)],shared=False,stateful=True,updated_at=2022-09-25T00:56:48Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:48.218609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ca9c0a34-70f1-4463-91c1-f965ad880f5d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (b05a07af-8842-4298-afaf-fd2a86db13a8), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:48.219923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ca9c0a34-70f1-4463-91c1-f965ad880f5d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:48Z,description=,direction='egress',ethertype='IPv4',id=20b8e6a0-2fd0-41bc-9e4f-40835a7fb4a1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d1d652f52ade4b488b76564ecb719bd5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b05a07af-8842-4298-afaf-fd2a86db13a8,updated_at=2022-09-25T00:56:48Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:48.220709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ca9c0a34-70f1-4463-91c1-f965ad880f5d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (20b8e6a0-2fd0-41bc-9e4f-40835a7fb4a1), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:48.221427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ca9c0a34-70f1-4463-91c1-f965ad880f5d admin admin] Security group rule updated ['b05a07af-8842-4298-afaf-fd2a86db13a8'] Sep 25 00:56:48.222857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ca9c0a34-70f1-4463-91c1-f965ad880f5d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:48Z,description=,direction='ingress',ethertype='IPv4',id=30854e74-6158-4fbf-8354-a49c618bdfd5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d1d652f52ade4b488b76564ecb719bd5',protocol=,remote_address_group_id=,remote_group_id=b05a07af-8842-4298-afaf-fd2a86db13a8,remote_ip_prefix=,revision_number=0,security_group_id=b05a07af-8842-4298-afaf-fd2a86db13a8,updated_at=2022-09-25T00:56:48Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:48.223588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ca9c0a34-70f1-4463-91c1-f965ad880f5d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (30854e74-6158-4fbf-8354-a49c618bdfd5), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:48.226176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ca9c0a34-70f1-4463-91c1-f965ad880f5d admin admin] Security group rule updated ['b05a07af-8842-4298-afaf-fd2a86db13a8'] Sep 25 00:56:48.227734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ca9c0a34-70f1-4463-91c1-f965ad880f5d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:48Z,description=,direction='egress',ethertype='IPv6',id=cfa07352-e2e3-40bc-a5c8-5f19a746ddf0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d1d652f52ade4b488b76564ecb719bd5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b05a07af-8842-4298-afaf-fd2a86db13a8,updated_at=2022-09-25T00:56:48Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:48.228718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ca9c0a34-70f1-4463-91c1-f965ad880f5d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (cfa07352-e2e3-40bc-a5c8-5f19a746ddf0), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:48.229292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ca9c0a34-70f1-4463-91c1-f965ad880f5d admin admin] Security group rule updated ['b05a07af-8842-4298-afaf-fd2a86db13a8'] Sep 25 00:56:48.230363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ca9c0a34-70f1-4463-91c1-f965ad880f5d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:48Z,description=,direction='ingress',ethertype='IPv6',id=f660d71b-5b1a-457f-9358-3c6c630553d4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d1d652f52ade4b488b76564ecb719bd5',protocol=,remote_address_group_id=,remote_group_id=b05a07af-8842-4298-afaf-fd2a86db13a8,remote_ip_prefix=,revision_number=0,security_group_id=b05a07af-8842-4298-afaf-fd2a86db13a8,updated_at=2022-09-25T00:56:48Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:48.230894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ca9c0a34-70f1-4463-91c1-f965ad880f5d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f660d71b-5b1a-457f-9358-3c6c630553d4), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:48.231249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ca9c0a34-70f1-4463-91c1-f965ad880f5d admin admin] Security group rule updated ['b05a07af-8842-4298-afaf-fd2a86db13a8'] Sep 25 00:56:48.491641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a96b7869-9b93-41de-9f2d-1f80a4aae839 admin admin] Resource SecurityGroup deleted: b05a07af-8842-4298-afaf-fd2a86db13a8 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:48.492158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a96b7869-9b93-41de-9f2d-1f80a4aae839 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (b05a07af-8842-4298-afaf-fd2a86db13a8), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:48.492622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a96b7869-9b93-41de-9f2d-1f80a4aae839 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('b05a07af-8842-4298-afaf-fd2a86db13a8',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:56:48.551717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a96b7869-9b93-41de-9f2d-1f80a4aae839 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('b05a07af-8842-4298-afaf-fd2a86db13a8',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:56:48.552751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a96b7869-9b93-41de-9f2d-1f80a4aae839 admin admin] Resource SecurityGroupRule deleted: 20b8e6a0-2fd0-41bc-9e4f-40835a7fb4a1 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:48.553846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a96b7869-9b93-41de-9f2d-1f80a4aae839 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (20b8e6a0-2fd0-41bc-9e4f-40835a7fb4a1), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:48.554603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a96b7869-9b93-41de-9f2d-1f80a4aae839 admin admin] Security group rule updated ['b05a07af-8842-4298-afaf-fd2a86db13a8'] Sep 25 00:56:48.555262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a96b7869-9b93-41de-9f2d-1f80a4aae839 admin admin] Resource SecurityGroupRule deleted: 30854e74-6158-4fbf-8354-a49c618bdfd5 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:48.555808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a96b7869-9b93-41de-9f2d-1f80a4aae839 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (30854e74-6158-4fbf-8354-a49c618bdfd5), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:48.556277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a96b7869-9b93-41de-9f2d-1f80a4aae839 admin admin] Security group rule updated ['b05a07af-8842-4298-afaf-fd2a86db13a8'] Sep 25 00:56:48.557048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a96b7869-9b93-41de-9f2d-1f80a4aae839 admin admin] Resource SecurityGroupRule deleted: cfa07352-e2e3-40bc-a5c8-5f19a746ddf0 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:48.557694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a96b7869-9b93-41de-9f2d-1f80a4aae839 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (cfa07352-e2e3-40bc-a5c8-5f19a746ddf0), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:48.558157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a96b7869-9b93-41de-9f2d-1f80a4aae839 admin admin] Security group rule updated ['b05a07af-8842-4298-afaf-fd2a86db13a8'] Sep 25 00:56:48.559230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a96b7869-9b93-41de-9f2d-1f80a4aae839 admin admin] Resource SecurityGroupRule deleted: f660d71b-5b1a-457f-9358-3c6c630553d4 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:48.560405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a96b7869-9b93-41de-9f2d-1f80a4aae839 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f660d71b-5b1a-457f-9358-3c6c630553d4), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:48.561425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a96b7869-9b93-41de-9f2d-1f80a4aae839 admin admin] Security group rule updated ['b05a07af-8842-4298-afaf-fd2a86db13a8'] Sep 25 00:56:49.123853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c0e46e7e-e0db-48f5-a2b2-20f6af9caaf3 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:48Z,description='Default security group',id=5ad93aa4-e3e6-4a20-a386-1c9036c835b7,is_default=True,name='default',project_id='ef8dd72bc2e0480aac0f1b8ad50ec274',revision_number=1,rules=[SecurityGroupRule(3650559d-aae3-4aee-afa8-d9f10a1cc477),SecurityGroupRule(78fc5b43-def0-4706-9e9d-1d4899ad908a),SecurityGroupRule(9ad758d0-a018-469b-af20-c32c4245d84c),SecurityGroupRule(a8eabe51-32b5-4ab5-8ae8-496ea9bd4414)],shared=False,stateful=True,updated_at=2022-09-25T00:56:48Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:49.125011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c0e46e7e-e0db-48f5-a2b2-20f6af9caaf3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (5ad93aa4-e3e6-4a20-a386-1c9036c835b7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:49.125809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c0e46e7e-e0db-48f5-a2b2-20f6af9caaf3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:48Z,description=,direction='egress',ethertype='IPv4',id=3650559d-aae3-4aee-afa8-d9f10a1cc477,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ef8dd72bc2e0480aac0f1b8ad50ec274',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5ad93aa4-e3e6-4a20-a386-1c9036c835b7,updated_at=2022-09-25T00:56:48Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:49.126355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c0e46e7e-e0db-48f5-a2b2-20f6af9caaf3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (3650559d-aae3-4aee-afa8-d9f10a1cc477), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:49.126838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c0e46e7e-e0db-48f5-a2b2-20f6af9caaf3 admin admin] Security group rule updated ['5ad93aa4-e3e6-4a20-a386-1c9036c835b7'] Sep 25 00:56:49.128134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c0e46e7e-e0db-48f5-a2b2-20f6af9caaf3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:48Z,description=,direction='ingress',ethertype='IPv4',id=78fc5b43-def0-4706-9e9d-1d4899ad908a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ef8dd72bc2e0480aac0f1b8ad50ec274',protocol=,remote_address_group_id=,remote_group_id=5ad93aa4-e3e6-4a20-a386-1c9036c835b7,remote_ip_prefix=,revision_number=0,security_group_id=5ad93aa4-e3e6-4a20-a386-1c9036c835b7,updated_at=2022-09-25T00:56:48Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:49.130011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c0e46e7e-e0db-48f5-a2b2-20f6af9caaf3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (78fc5b43-def0-4706-9e9d-1d4899ad908a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:49.130353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c0e46e7e-e0db-48f5-a2b2-20f6af9caaf3 admin admin] Security group rule updated ['5ad93aa4-e3e6-4a20-a386-1c9036c835b7'] Sep 25 00:56:49.131807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c0e46e7e-e0db-48f5-a2b2-20f6af9caaf3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:48Z,description=,direction='ingress',ethertype='IPv6',id=9ad758d0-a018-469b-af20-c32c4245d84c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ef8dd72bc2e0480aac0f1b8ad50ec274',protocol=,remote_address_group_id=,remote_group_id=5ad93aa4-e3e6-4a20-a386-1c9036c835b7,remote_ip_prefix=,revision_number=0,security_group_id=5ad93aa4-e3e6-4a20-a386-1c9036c835b7,updated_at=2022-09-25T00:56:48Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:49.132617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c0e46e7e-e0db-48f5-a2b2-20f6af9caaf3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (9ad758d0-a018-469b-af20-c32c4245d84c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:49.133097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c0e46e7e-e0db-48f5-a2b2-20f6af9caaf3 admin admin] Security group rule updated ['5ad93aa4-e3e6-4a20-a386-1c9036c835b7'] Sep 25 00:56:49.134079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c0e46e7e-e0db-48f5-a2b2-20f6af9caaf3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:48Z,description=,direction='egress',ethertype='IPv6',id=a8eabe51-32b5-4ab5-8ae8-496ea9bd4414,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ef8dd72bc2e0480aac0f1b8ad50ec274',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5ad93aa4-e3e6-4a20-a386-1c9036c835b7,updated_at=2022-09-25T00:56:48Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:49.134438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c0e46e7e-e0db-48f5-a2b2-20f6af9caaf3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (a8eabe51-32b5-4ab5-8ae8-496ea9bd4414), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:49.135039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c0e46e7e-e0db-48f5-a2b2-20f6af9caaf3 admin admin] Security group rule updated ['5ad93aa4-e3e6-4a20-a386-1c9036c835b7'] Sep 25 00:56:49.341420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-65e9c757-a385-48d5-b9a4-9d4a5ecc31d7 admin admin] Resource SecurityGroup deleted: 5ad93aa4-e3e6-4a20-a386-1c9036c835b7 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:49.342159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-65e9c757-a385-48d5-b9a4-9d4a5ecc31d7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (5ad93aa4-e3e6-4a20-a386-1c9036c835b7), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:49.343228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65e9c757-a385-48d5-b9a4-9d4a5ecc31d7 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('5ad93aa4-e3e6-4a20-a386-1c9036c835b7',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:56:49.360178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-65e9c757-a385-48d5-b9a4-9d4a5ecc31d7 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('5ad93aa4-e3e6-4a20-a386-1c9036c835b7',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:56:49.361431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-65e9c757-a385-48d5-b9a4-9d4a5ecc31d7 admin admin] Resource SecurityGroupRule deleted: 3650559d-aae3-4aee-afa8-d9f10a1cc477 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:49.361819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-65e9c757-a385-48d5-b9a4-9d4a5ecc31d7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (3650559d-aae3-4aee-afa8-d9f10a1cc477), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:49.362164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-65e9c757-a385-48d5-b9a4-9d4a5ecc31d7 admin admin] Security group rule updated ['5ad93aa4-e3e6-4a20-a386-1c9036c835b7'] Sep 25 00:56:49.363333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-65e9c757-a385-48d5-b9a4-9d4a5ecc31d7 admin admin] Resource SecurityGroupRule deleted: 78fc5b43-def0-4706-9e9d-1d4899ad908a {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:49.363848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-65e9c757-a385-48d5-b9a4-9d4a5ecc31d7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (78fc5b43-def0-4706-9e9d-1d4899ad908a), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:49.364322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-65e9c757-a385-48d5-b9a4-9d4a5ecc31d7 admin admin] Security group rule updated ['5ad93aa4-e3e6-4a20-a386-1c9036c835b7'] Sep 25 00:56:49.373670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-65e9c757-a385-48d5-b9a4-9d4a5ecc31d7 admin admin] Resource SecurityGroupRule deleted: 9ad758d0-a018-469b-af20-c32c4245d84c {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:49.373670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-65e9c757-a385-48d5-b9a4-9d4a5ecc31d7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (9ad758d0-a018-469b-af20-c32c4245d84c), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:49.373670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-65e9c757-a385-48d5-b9a4-9d4a5ecc31d7 admin admin] Security group rule updated ['5ad93aa4-e3e6-4a20-a386-1c9036c835b7'] Sep 25 00:56:49.373670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-65e9c757-a385-48d5-b9a4-9d4a5ecc31d7 admin admin] Resource SecurityGroupRule deleted: a8eabe51-32b5-4ab5-8ae8-496ea9bd4414 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:49.373670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-65e9c757-a385-48d5-b9a4-9d4a5ecc31d7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (a8eabe51-32b5-4ab5-8ae8-496ea9bd4414), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:49.374393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-65e9c757-a385-48d5-b9a4-9d4a5ecc31d7 admin admin] Security group rule updated ['5ad93aa4-e3e6-4a20-a386-1c9036c835b7'] Sep 25 00:56:49.600859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:279 started Sep 25 00:56:49.604808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dee7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=330000000,duration_sec=572,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:49.605842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:56:49.606328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:279 - starting polling. Elapsed:0.006 Sep 25 00:56:49.608795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:49.617041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:279 - port information retrieved. Elapsed:0.014 Sep 25 00:56:49.617774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:279 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Sep 25 00:56:51.093525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 96168749-3e0f-462f-9aed-adacd4fb28c0 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:51.094679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (96168749-3e0f-462f-9aed-adacd4fb28c0), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:51.165127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1d91d9b8-1e36-4d4c-ad6f-2657031e3a8f admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:50Z,description='Default security group',id=817fa38d-1c70-4312-8db9-9a29b97970bb,is_default=True,name='default',project_id='7cefb5d1dcb640a4b0ad87daa1418fae',revision_number=1,rules=[SecurityGroupRule(4070242f-36e7-4f06-b049-8345a9151e3c),SecurityGroupRule(6db5d61f-b12a-49ae-b5ee-b036613d218a),SecurityGroupRule(9a48c0c2-9c77-4fbe-b9be-0161b32845f9),SecurityGroupRule(b530b4a5-75ae-4dd7-aae5-35537e69a24f)],shared=False,stateful=True,updated_at=2022-09-25T00:56:51Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:51.168055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1d91d9b8-1e36-4d4c-ad6f-2657031e3a8f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (817fa38d-1c70-4312-8db9-9a29b97970bb), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:51.168957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1d91d9b8-1e36-4d4c-ad6f-2657031e3a8f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:50Z,description=,direction='ingress',ethertype='IPv4',id=4070242f-36e7-4f06-b049-8345a9151e3c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7cefb5d1dcb640a4b0ad87daa1418fae',protocol=,remote_address_group_id=,remote_group_id=817fa38d-1c70-4312-8db9-9a29b97970bb,remote_ip_prefix=,revision_number=0,security_group_id=817fa38d-1c70-4312-8db9-9a29b97970bb,updated_at=2022-09-25T00:56:50Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:51.170569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1d91d9b8-1e36-4d4c-ad6f-2657031e3a8f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (4070242f-36e7-4f06-b049-8345a9151e3c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:51.172805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1d91d9b8-1e36-4d4c-ad6f-2657031e3a8f admin admin] Security group rule updated ['817fa38d-1c70-4312-8db9-9a29b97970bb'] Sep 25 00:56:51.174877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1d91d9b8-1e36-4d4c-ad6f-2657031e3a8f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:51Z,description=,direction='egress',ethertype='IPv6',id=6db5d61f-b12a-49ae-b5ee-b036613d218a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7cefb5d1dcb640a4b0ad87daa1418fae',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=817fa38d-1c70-4312-8db9-9a29b97970bb,updated_at=2022-09-25T00:56:51Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:51.176043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1d91d9b8-1e36-4d4c-ad6f-2657031e3a8f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (6db5d61f-b12a-49ae-b5ee-b036613d218a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:51.178281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1d91d9b8-1e36-4d4c-ad6f-2657031e3a8f admin admin] Security group rule updated ['817fa38d-1c70-4312-8db9-9a29b97970bb'] Sep 25 00:56:51.179126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1d91d9b8-1e36-4d4c-ad6f-2657031e3a8f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:51Z,description=,direction='egress',ethertype='IPv4',id=9a48c0c2-9c77-4fbe-b9be-0161b32845f9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7cefb5d1dcb640a4b0ad87daa1418fae',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=817fa38d-1c70-4312-8db9-9a29b97970bb,updated_at=2022-09-25T00:56:51Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:51.181657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1d91d9b8-1e36-4d4c-ad6f-2657031e3a8f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (9a48c0c2-9c77-4fbe-b9be-0161b32845f9), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:51.182767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1d91d9b8-1e36-4d4c-ad6f-2657031e3a8f admin admin] Security group rule updated ['817fa38d-1c70-4312-8db9-9a29b97970bb'] Sep 25 00:56:51.184020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1d91d9b8-1e36-4d4c-ad6f-2657031e3a8f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:51Z,description=,direction='ingress',ethertype='IPv6',id=b530b4a5-75ae-4dd7-aae5-35537e69a24f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7cefb5d1dcb640a4b0ad87daa1418fae',protocol=,remote_address_group_id=,remote_group_id=817fa38d-1c70-4312-8db9-9a29b97970bb,remote_ip_prefix=,revision_number=0,security_group_id=817fa38d-1c70-4312-8db9-9a29b97970bb,updated_at=2022-09-25T00:56:51Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:51.186906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1d91d9b8-1e36-4d4c-ad6f-2657031e3a8f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (b530b4a5-75ae-4dd7-aae5-35537e69a24f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:51.188046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1d91d9b8-1e36-4d4c-ad6f-2657031e3a8f admin admin] Security group rule updated ['817fa38d-1c70-4312-8db9-9a29b97970bb'] Sep 25 00:56:51.371727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1bb97f5c-23fc-4070-947f-22a7a989c5ff admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:51Z,description='Default security group',id=7ad4e2ea-12a4-4242-baae-4ae67e21523f,is_default=True,name='default',project_id='e463fe4d96b04d6fa3224a417eeeeadc',revision_number=1,rules=[SecurityGroupRule(5a7923fc-5936-40e8-8879-846315808fe4),SecurityGroupRule(6ba3f91e-7f00-40dd-b54a-44def3cd3fc1),SecurityGroupRule(89928127-39b6-4e63-89bb-f6309321de94),SecurityGroupRule(a7942531-42ad-437a-a522-587e0bdfb73c)],shared=False,stateful=True,updated_at=2022-09-25T00:56:51Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:51.372293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1bb97f5c-23fc-4070-947f-22a7a989c5ff admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (7ad4e2ea-12a4-4242-baae-4ae67e21523f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:51.373109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1bb97f5c-23fc-4070-947f-22a7a989c5ff admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:51Z,description=,direction='ingress',ethertype='IPv4',id=5a7923fc-5936-40e8-8879-846315808fe4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e463fe4d96b04d6fa3224a417eeeeadc',protocol=,remote_address_group_id=,remote_group_id=7ad4e2ea-12a4-4242-baae-4ae67e21523f,remote_ip_prefix=,revision_number=0,security_group_id=7ad4e2ea-12a4-4242-baae-4ae67e21523f,updated_at=2022-09-25T00:56:51Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:51.374030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1bb97f5c-23fc-4070-947f-22a7a989c5ff admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (5a7923fc-5936-40e8-8879-846315808fe4), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:51.374381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1bb97f5c-23fc-4070-947f-22a7a989c5ff admin admin] Security group rule updated ['7ad4e2ea-12a4-4242-baae-4ae67e21523f'] Sep 25 00:56:51.375088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1bb97f5c-23fc-4070-947f-22a7a989c5ff admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:51Z,description=,direction='ingress',ethertype='IPv6',id=6ba3f91e-7f00-40dd-b54a-44def3cd3fc1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e463fe4d96b04d6fa3224a417eeeeadc',protocol=,remote_address_group_id=,remote_group_id=7ad4e2ea-12a4-4242-baae-4ae67e21523f,remote_ip_prefix=,revision_number=0,security_group_id=7ad4e2ea-12a4-4242-baae-4ae67e21523f,updated_at=2022-09-25T00:56:51Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:51.375574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1bb97f5c-23fc-4070-947f-22a7a989c5ff admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (6ba3f91e-7f00-40dd-b54a-44def3cd3fc1), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:51.375968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1bb97f5c-23fc-4070-947f-22a7a989c5ff admin admin] Security group rule updated ['7ad4e2ea-12a4-4242-baae-4ae67e21523f'] Sep 25 00:56:51.379740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1bb97f5c-23fc-4070-947f-22a7a989c5ff admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:51Z,description=,direction='egress',ethertype='IPv4',id=89928127-39b6-4e63-89bb-f6309321de94,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e463fe4d96b04d6fa3224a417eeeeadc',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7ad4e2ea-12a4-4242-baae-4ae67e21523f,updated_at=2022-09-25T00:56:51Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:51.380241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1bb97f5c-23fc-4070-947f-22a7a989c5ff admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (89928127-39b6-4e63-89bb-f6309321de94), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:51.381879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1bb97f5c-23fc-4070-947f-22a7a989c5ff admin admin] Security group rule updated ['7ad4e2ea-12a4-4242-baae-4ae67e21523f'] Sep 25 00:56:51.384361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1bb97f5c-23fc-4070-947f-22a7a989c5ff admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:51Z,description=,direction='egress',ethertype='IPv6',id=a7942531-42ad-437a-a522-587e0bdfb73c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e463fe4d96b04d6fa3224a417eeeeadc',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7ad4e2ea-12a4-4242-baae-4ae67e21523f,updated_at=2022-09-25T00:56:51Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:51.388708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1bb97f5c-23fc-4070-947f-22a7a989c5ff admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (a7942531-42ad-437a-a522-587e0bdfb73c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:51.390510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1bb97f5c-23fc-4070-947f-22a7a989c5ff admin admin] Security group rule updated ['7ad4e2ea-12a4-4242-baae-4ae67e21523f'] Sep 25 00:56:51.603590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:280 started Sep 25 00:56:51.606995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dee9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=332000000,duration_sec=574,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:51.607984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:56:51.612320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:280 - starting polling. Elapsed:0.005 Sep 25 00:56:51.616019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:51.622671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:280 - port information retrieved. Elapsed:0.019 Sep 25 00:56:51.623644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:280 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.020 Sep 25 00:56:51.796063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 9618d105-fdf7-4a07-9a29-e94ba03b6c41 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:56:51.796772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (9618d105-fdf7-4a07-9a29-e94ba03b6c41), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:51.909689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1680e176-43e2-4c2d-ba8f-4d5874d3167f admin admin] Resource SecurityGroup deleted: 817fa38d-1c70-4312-8db9-9a29b97970bb {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:51.910703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1680e176-43e2-4c2d-ba8f-4d5874d3167f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (817fa38d-1c70-4312-8db9-9a29b97970bb), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:51.911722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1680e176-43e2-4c2d-ba8f-4d5874d3167f admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('817fa38d-1c70-4312-8db9-9a29b97970bb',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:56:51.935160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1680e176-43e2-4c2d-ba8f-4d5874d3167f admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('817fa38d-1c70-4312-8db9-9a29b97970bb',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:56:51.936592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1680e176-43e2-4c2d-ba8f-4d5874d3167f admin admin] Resource SecurityGroupRule deleted: 4070242f-36e7-4f06-b049-8345a9151e3c {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:51.937474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1680e176-43e2-4c2d-ba8f-4d5874d3167f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (4070242f-36e7-4f06-b049-8345a9151e3c), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:51.938309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1680e176-43e2-4c2d-ba8f-4d5874d3167f admin admin] Security group rule updated ['817fa38d-1c70-4312-8db9-9a29b97970bb'] Sep 25 00:56:51.942969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1680e176-43e2-4c2d-ba8f-4d5874d3167f admin admin] Resource SecurityGroupRule deleted: 6db5d61f-b12a-49ae-b5ee-b036613d218a {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:51.944778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1680e176-43e2-4c2d-ba8f-4d5874d3167f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (6db5d61f-b12a-49ae-b5ee-b036613d218a), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:51.946854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1680e176-43e2-4c2d-ba8f-4d5874d3167f admin admin] Security group rule updated ['817fa38d-1c70-4312-8db9-9a29b97970bb'] Sep 25 00:56:51.951787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1680e176-43e2-4c2d-ba8f-4d5874d3167f admin admin] Resource SecurityGroupRule deleted: 9a48c0c2-9c77-4fbe-b9be-0161b32845f9 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:51.952832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1680e176-43e2-4c2d-ba8f-4d5874d3167f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (9a48c0c2-9c77-4fbe-b9be-0161b32845f9), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:51.953674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1680e176-43e2-4c2d-ba8f-4d5874d3167f admin admin] Security group rule updated ['817fa38d-1c70-4312-8db9-9a29b97970bb'] Sep 25 00:56:51.956992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1680e176-43e2-4c2d-ba8f-4d5874d3167f admin admin] Resource SecurityGroupRule deleted: b530b4a5-75ae-4dd7-aae5-35537e69a24f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:51.960239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1680e176-43e2-4c2d-ba8f-4d5874d3167f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (b530b4a5-75ae-4dd7-aae5-35537e69a24f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:51.963034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1680e176-43e2-4c2d-ba8f-4d5874d3167f admin admin] Security group rule updated ['817fa38d-1c70-4312-8db9-9a29b97970bb'] Sep 25 00:56:52.216561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1bb97f5c-23fc-4070-947f-22a7a989c5ff admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-25T00:56:51Z,description='',dns_domain=None,id=98bf713b-ce3d-430d-9b8a-f3f243e74a76,mtu=1500,name='tempest-VolumesActionsTest-1984619413-network',project_id='e463fe4d96b04d6fa3224a417eeeeadc',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(98bf713b-ce3d-430d-9b8a-f3f243e74a76),segments=[NetworkSegment(6da57ede-5266-40ee-a238-a4d2238b2ba4)],shared=False,status='ACTIVE',updated_at=2022-09-25T00:56:51Z,vlan_transparent=) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:52.219103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1bb97f5c-23fc-4070-947f-22a7a989c5ff admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (98bf713b-ce3d-430d-9b8a-f3f243e74a76), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:52.456318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager [None req-1bb97f5c-23fc-4070-947f-22a7a989c5ff admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 98bf713b-ce3d-430d-9b8a-f3f243e74a76 with segmentation id not found. Sep 25 00:56:52.456318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 25 00:56:52.456318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 25 00:56:52.456318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 25 00:56:52.456318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 25 00:56:52.456318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 25 00:56:52.456318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 25 00:56:52.456318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 25 00:56:52.456318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 25 00:56:52.456318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 25 00:56:52.456318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 25 00:56:52.456318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 25 00:56:52.456318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 25 00:56:52.457243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 25 00:56:52.457243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 25 00:56:52.457243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 25 00:56:52.457243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 98bf713b-ce3d-430d-9b8a-f3f243e74a76 with segmentation id not found. Sep 25 00:56:52.457243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Sep 25 00:56:52.895134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-eeecab4b-3230-4701-8b9f-993415b4f723 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(80e723c0-004e-408a-adf5-490affbd4985)],cidr=172.20.0.0/28,created_at=2022-09-25T00:56:52Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=628d6164-8561-43a3-90c1-471d3db273ff,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-VolumesActionsTest-1984619413-subnet',network_id=98bf713b-ce3d-430d-9b8a-f3f243e74a76,project_id='e463fe4d96b04d6fa3224a417eeeeadc',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-25T00:56:52Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:52.896020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-eeecab4b-3230-4701-8b9f-993415b4f723 admin admin] Publish callbacks [] for Subnet (628d6164-8561-43a3-90c1-471d3db273ff), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:53.055556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1774e0fa-e73f-45f8-8f7a-d75bfbf0c5ba admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:52Z,description='Default security group',id=bf9dd712-b501-434e-b298-72ba943361e3,is_default=True,name='default',project_id='ebcbfdd554ab41299a6932ab451d0072',revision_number=1,rules=[SecurityGroupRule(5d0bd3e8-7908-4ef7-a898-14e86df1fcdf),SecurityGroupRule(8f7465cd-3d85-41bb-a4ab-c6a751919b5f),SecurityGroupRule(90d18a0f-27d7-4165-a059-a816acff0134),SecurityGroupRule(f1864467-5df2-4da3-a0bf-c908692f5591)],shared=False,stateful=True,updated_at=2022-09-25T00:56:52Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:53.056618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1774e0fa-e73f-45f8-8f7a-d75bfbf0c5ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (bf9dd712-b501-434e-b298-72ba943361e3), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:53.058233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1774e0fa-e73f-45f8-8f7a-d75bfbf0c5ba admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:52Z,description=,direction='ingress',ethertype='IPv6',id=5d0bd3e8-7908-4ef7-a898-14e86df1fcdf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ebcbfdd554ab41299a6932ab451d0072',protocol=,remote_address_group_id=,remote_group_id=bf9dd712-b501-434e-b298-72ba943361e3,remote_ip_prefix=,revision_number=0,security_group_id=bf9dd712-b501-434e-b298-72ba943361e3,updated_at=2022-09-25T00:56:52Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:53.058846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1774e0fa-e73f-45f8-8f7a-d75bfbf0c5ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (5d0bd3e8-7908-4ef7-a898-14e86df1fcdf), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:53.059845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1774e0fa-e73f-45f8-8f7a-d75bfbf0c5ba admin admin] Security group rule updated ['bf9dd712-b501-434e-b298-72ba943361e3'] Sep 25 00:56:53.060787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1774e0fa-e73f-45f8-8f7a-d75bfbf0c5ba admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:52Z,description=,direction='egress',ethertype='IPv4',id=8f7465cd-3d85-41bb-a4ab-c6a751919b5f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ebcbfdd554ab41299a6932ab451d0072',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=bf9dd712-b501-434e-b298-72ba943361e3,updated_at=2022-09-25T00:56:52Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:53.061484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1774e0fa-e73f-45f8-8f7a-d75bfbf0c5ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (8f7465cd-3d85-41bb-a4ab-c6a751919b5f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:53.062087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1774e0fa-e73f-45f8-8f7a-d75bfbf0c5ba admin admin] Security group rule updated ['bf9dd712-b501-434e-b298-72ba943361e3'] Sep 25 00:56:53.063074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1774e0fa-e73f-45f8-8f7a-d75bfbf0c5ba admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:52Z,description=,direction='ingress',ethertype='IPv4',id=90d18a0f-27d7-4165-a059-a816acff0134,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ebcbfdd554ab41299a6932ab451d0072',protocol=,remote_address_group_id=,remote_group_id=bf9dd712-b501-434e-b298-72ba943361e3,remote_ip_prefix=,revision_number=0,security_group_id=bf9dd712-b501-434e-b298-72ba943361e3,updated_at=2022-09-25T00:56:52Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:53.065242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1774e0fa-e73f-45f8-8f7a-d75bfbf0c5ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (90d18a0f-27d7-4165-a059-a816acff0134), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:53.071386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1774e0fa-e73f-45f8-8f7a-d75bfbf0c5ba admin admin] Security group rule updated ['bf9dd712-b501-434e-b298-72ba943361e3'] Sep 25 00:56:53.072499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1774e0fa-e73f-45f8-8f7a-d75bfbf0c5ba admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:52Z,description=,direction='egress',ethertype='IPv6',id=f1864467-5df2-4da3-a0bf-c908692f5591,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ebcbfdd554ab41299a6932ab451d0072',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=bf9dd712-b501-434e-b298-72ba943361e3,updated_at=2022-09-25T00:56:52Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:53.074751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1774e0fa-e73f-45f8-8f7a-d75bfbf0c5ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f1864467-5df2-4da3-a0bf-c908692f5591), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:53.075321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1774e0fa-e73f-45f8-8f7a-d75bfbf0c5ba admin admin] Security group rule updated ['bf9dd712-b501-434e-b298-72ba943361e3'] Sep 25 00:56:53.133548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9f6ccd07-67a1-4753-a851-891c2d32fe3b admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:52Z,description='Default security group',id=670cb50d-6846-42dc-8e26-2f3af2e46861,is_default=True,name='default',project_id='949e5c4b9d274f488df36e640d3b9eec',revision_number=1,rules=[SecurityGroupRule(883e0462-6b9c-47c4-b095-ba0d1c7e7b53),SecurityGroupRule(aefddda1-e0c1-463b-86e6-1b9a7ca50c6e),SecurityGroupRule(e88de327-b2de-4ce2-92c7-de892d167961),SecurityGroupRule(f5281c9a-83d6-42ca-a311-c3e991c18727)],shared=False,stateful=True,updated_at=2022-09-25T00:56:52Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:53.135516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9f6ccd07-67a1-4753-a851-891c2d32fe3b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (670cb50d-6846-42dc-8e26-2f3af2e46861), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:53.137201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9f6ccd07-67a1-4753-a851-891c2d32fe3b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:52Z,description=,direction='egress',ethertype='IPv4',id=883e0462-6b9c-47c4-b095-ba0d1c7e7b53,normalized_cidr=None,port_range_max=,port_range_min=,project_id='949e5c4b9d274f488df36e640d3b9eec',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=670cb50d-6846-42dc-8e26-2f3af2e46861,updated_at=2022-09-25T00:56:52Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:53.137949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9f6ccd07-67a1-4753-a851-891c2d32fe3b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (883e0462-6b9c-47c4-b095-ba0d1c7e7b53), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:53.138724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9f6ccd07-67a1-4753-a851-891c2d32fe3b admin admin] Security group rule updated ['670cb50d-6846-42dc-8e26-2f3af2e46861'] Sep 25 00:56:53.139616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9f6ccd07-67a1-4753-a851-891c2d32fe3b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:52Z,description=,direction='ingress',ethertype='IPv4',id=aefddda1-e0c1-463b-86e6-1b9a7ca50c6e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='949e5c4b9d274f488df36e640d3b9eec',protocol=,remote_address_group_id=,remote_group_id=670cb50d-6846-42dc-8e26-2f3af2e46861,remote_ip_prefix=,revision_number=0,security_group_id=670cb50d-6846-42dc-8e26-2f3af2e46861,updated_at=2022-09-25T00:56:52Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:53.140176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9f6ccd07-67a1-4753-a851-891c2d32fe3b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (aefddda1-e0c1-463b-86e6-1b9a7ca50c6e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:53.140984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9f6ccd07-67a1-4753-a851-891c2d32fe3b admin admin] Security group rule updated ['670cb50d-6846-42dc-8e26-2f3af2e46861'] Sep 25 00:56:53.141835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9f6ccd07-67a1-4753-a851-891c2d32fe3b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:52Z,description=,direction='egress',ethertype='IPv6',id=e88de327-b2de-4ce2-92c7-de892d167961,normalized_cidr=None,port_range_max=,port_range_min=,project_id='949e5c4b9d274f488df36e640d3b9eec',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=670cb50d-6846-42dc-8e26-2f3af2e46861,updated_at=2022-09-25T00:56:52Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:53.142376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9f6ccd07-67a1-4753-a851-891c2d32fe3b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (e88de327-b2de-4ce2-92c7-de892d167961), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:53.142913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9f6ccd07-67a1-4753-a851-891c2d32fe3b admin admin] Security group rule updated ['670cb50d-6846-42dc-8e26-2f3af2e46861'] Sep 25 00:56:53.143978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9f6ccd07-67a1-4753-a851-891c2d32fe3b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:52Z,description=,direction='ingress',ethertype='IPv6',id=f5281c9a-83d6-42ca-a311-c3e991c18727,normalized_cidr=None,port_range_max=,port_range_min=,project_id='949e5c4b9d274f488df36e640d3b9eec',protocol=,remote_address_group_id=,remote_group_id=670cb50d-6846-42dc-8e26-2f3af2e46861,remote_ip_prefix=,revision_number=0,security_group_id=670cb50d-6846-42dc-8e26-2f3af2e46861,updated_at=2022-09-25T00:56:52Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:53.144680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9f6ccd07-67a1-4753-a851-891c2d32fe3b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f5281c9a-83d6-42ca-a311-c3e991c18727), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:53.145203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9f6ccd07-67a1-4753-a851-891c2d32fe3b admin admin] Security group rule updated ['670cb50d-6846-42dc-8e26-2f3af2e46861'] Sep 25 00:56:53.330277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d963fb6b-921b-4629-9afb-c37c632b605e admin admin] Resource SecurityGroup deleted: 670cb50d-6846-42dc-8e26-2f3af2e46861 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:53.330794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d963fb6b-921b-4629-9afb-c37c632b605e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (670cb50d-6846-42dc-8e26-2f3af2e46861), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:53.331642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d963fb6b-921b-4629-9afb-c37c632b605e admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('670cb50d-6846-42dc-8e26-2f3af2e46861',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:56:53.473798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d963fb6b-921b-4629-9afb-c37c632b605e admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('670cb50d-6846-42dc-8e26-2f3af2e46861',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:56:53.474530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d963fb6b-921b-4629-9afb-c37c632b605e admin admin] Resource SecurityGroupRule deleted: 883e0462-6b9c-47c4-b095-ba0d1c7e7b53 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:53.475127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d963fb6b-921b-4629-9afb-c37c632b605e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (883e0462-6b9c-47c4-b095-ba0d1c7e7b53), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:53.475918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d963fb6b-921b-4629-9afb-c37c632b605e admin admin] Security group rule updated ['670cb50d-6846-42dc-8e26-2f3af2e46861'] Sep 25 00:56:53.476608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d963fb6b-921b-4629-9afb-c37c632b605e admin admin] Resource SecurityGroupRule deleted: aefddda1-e0c1-463b-86e6-1b9a7ca50c6e {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:53.477684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d963fb6b-921b-4629-9afb-c37c632b605e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (aefddda1-e0c1-463b-86e6-1b9a7ca50c6e), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:53.478592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d963fb6b-921b-4629-9afb-c37c632b605e admin admin] Security group rule updated ['670cb50d-6846-42dc-8e26-2f3af2e46861'] Sep 25 00:56:53.479482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d963fb6b-921b-4629-9afb-c37c632b605e admin admin] Resource SecurityGroupRule deleted: e88de327-b2de-4ce2-92c7-de892d167961 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:53.480637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d963fb6b-921b-4629-9afb-c37c632b605e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (e88de327-b2de-4ce2-92c7-de892d167961), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:53.481515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d963fb6b-921b-4629-9afb-c37c632b605e admin admin] Security group rule updated ['670cb50d-6846-42dc-8e26-2f3af2e46861'] Sep 25 00:56:53.482321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d963fb6b-921b-4629-9afb-c37c632b605e admin admin] Resource SecurityGroupRule deleted: f5281c9a-83d6-42ca-a311-c3e991c18727 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:53.483831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d963fb6b-921b-4629-9afb-c37c632b605e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f5281c9a-83d6-42ca-a311-c3e991c18727), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:53.485684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d963fb6b-921b-4629-9afb-c37c632b605e admin admin] Security group rule updated ['670cb50d-6846-42dc-8e26-2f3af2e46861'] Sep 25 00:56:53.588111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-99e4f572-e42c-4bce-9040-4c303aa7025c admin admin] Resource SecurityGroup deleted: bf9dd712-b501-434e-b298-72ba943361e3 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:53.588493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-99e4f572-e42c-4bce-9040-4c303aa7025c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (bf9dd712-b501-434e-b298-72ba943361e3), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:53.589443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99e4f572-e42c-4bce-9040-4c303aa7025c admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('bf9dd712-b501-434e-b298-72ba943361e3',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:56:53.606197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:281 started Sep 25 00:56:53.610731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834deeb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=335000000,duration_sec=576,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:53.611737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:56:53.612403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:281 - starting polling. Elapsed:0.006 Sep 25 00:56:53.625500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:53.645279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:281 - port information retrieved. Elapsed:0.038 Sep 25 00:56:53.650997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:281 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.040 Sep 25 00:56:53.665974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-99e4f572-e42c-4bce-9040-4c303aa7025c admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('bf9dd712-b501-434e-b298-72ba943361e3',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:56:53.666608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-99e4f572-e42c-4bce-9040-4c303aa7025c admin admin] Resource SecurityGroupRule deleted: 5d0bd3e8-7908-4ef7-a898-14e86df1fcdf {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:53.666996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-99e4f572-e42c-4bce-9040-4c303aa7025c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (5d0bd3e8-7908-4ef7-a898-14e86df1fcdf), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:53.669125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-99e4f572-e42c-4bce-9040-4c303aa7025c admin admin] Security group rule updated ['bf9dd712-b501-434e-b298-72ba943361e3'] Sep 25 00:56:53.670970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-99e4f572-e42c-4bce-9040-4c303aa7025c admin admin] Resource SecurityGroupRule deleted: 8f7465cd-3d85-41bb-a4ab-c6a751919b5f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:53.674652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-99e4f572-e42c-4bce-9040-4c303aa7025c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (8f7465cd-3d85-41bb-a4ab-c6a751919b5f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:53.675206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-99e4f572-e42c-4bce-9040-4c303aa7025c admin admin] Security group rule updated ['bf9dd712-b501-434e-b298-72ba943361e3'] Sep 25 00:56:53.675934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-99e4f572-e42c-4bce-9040-4c303aa7025c admin admin] Resource SecurityGroupRule deleted: 90d18a0f-27d7-4165-a059-a816acff0134 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:53.677119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-99e4f572-e42c-4bce-9040-4c303aa7025c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (90d18a0f-27d7-4165-a059-a816acff0134), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:53.679775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-99e4f572-e42c-4bce-9040-4c303aa7025c admin admin] Security group rule updated ['bf9dd712-b501-434e-b298-72ba943361e3'] Sep 25 00:56:53.681843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-99e4f572-e42c-4bce-9040-4c303aa7025c admin admin] Resource SecurityGroupRule deleted: f1864467-5df2-4da3-a0bf-c908692f5591 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:53.684405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-99e4f572-e42c-4bce-9040-4c303aa7025c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f1864467-5df2-4da3-a0bf-c908692f5591), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:53.685896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-99e4f572-e42c-4bce-9040-4c303aa7025c admin admin] Security group rule updated ['bf9dd712-b501-434e-b298-72ba943361e3'] Sep 25 00:56:54.395422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fcb09c0b-0fbe-4f08-bbf8-b7aa54eba39f admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:54Z,description='Default security group',id=be7134f8-623c-4146-a37b-2b4a6b9d55ef,is_default=True,name='default',project_id='56d0ea5794f14f8d96f6b48d16fa108e',revision_number=1,rules=[SecurityGroupRule(20f1f016-3e2d-448e-8ae0-4a35d6023d2a),SecurityGroupRule(752a37b6-7d09-462b-becf-fd5560ccfaf5),SecurityGroupRule(9f0b331e-03a4-4a31-b1dd-2df555a68c25),SecurityGroupRule(ed733426-5f34-4c93-811a-092a82615193)],shared=False,stateful=True,updated_at=2022-09-25T00:56:54Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:54.396030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fcb09c0b-0fbe-4f08-bbf8-b7aa54eba39f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (be7134f8-623c-4146-a37b-2b4a6b9d55ef), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:54.399722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fcb09c0b-0fbe-4f08-bbf8-b7aa54eba39f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:54Z,description=,direction='egress',ethertype='IPv6',id=20f1f016-3e2d-448e-8ae0-4a35d6023d2a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='56d0ea5794f14f8d96f6b48d16fa108e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=be7134f8-623c-4146-a37b-2b4a6b9d55ef,updated_at=2022-09-25T00:56:54Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:54.400919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fcb09c0b-0fbe-4f08-bbf8-b7aa54eba39f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (20f1f016-3e2d-448e-8ae0-4a35d6023d2a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:54.402261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-fcb09c0b-0fbe-4f08-bbf8-b7aa54eba39f admin admin] Security group rule updated ['be7134f8-623c-4146-a37b-2b4a6b9d55ef'] Sep 25 00:56:54.405567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fcb09c0b-0fbe-4f08-bbf8-b7aa54eba39f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:54Z,description=,direction='ingress',ethertype='IPv6',id=752a37b6-7d09-462b-becf-fd5560ccfaf5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='56d0ea5794f14f8d96f6b48d16fa108e',protocol=,remote_address_group_id=,remote_group_id=be7134f8-623c-4146-a37b-2b4a6b9d55ef,remote_ip_prefix=,revision_number=0,security_group_id=be7134f8-623c-4146-a37b-2b4a6b9d55ef,updated_at=2022-09-25T00:56:54Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:54.406192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fcb09c0b-0fbe-4f08-bbf8-b7aa54eba39f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (752a37b6-7d09-462b-becf-fd5560ccfaf5), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:54.408790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-fcb09c0b-0fbe-4f08-bbf8-b7aa54eba39f admin admin] Security group rule updated ['be7134f8-623c-4146-a37b-2b4a6b9d55ef'] Sep 25 00:56:54.409727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fcb09c0b-0fbe-4f08-bbf8-b7aa54eba39f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:54Z,description=,direction='ingress',ethertype='IPv4',id=9f0b331e-03a4-4a31-b1dd-2df555a68c25,normalized_cidr=None,port_range_max=,port_range_min=,project_id='56d0ea5794f14f8d96f6b48d16fa108e',protocol=,remote_address_group_id=,remote_group_id=be7134f8-623c-4146-a37b-2b4a6b9d55ef,remote_ip_prefix=,revision_number=0,security_group_id=be7134f8-623c-4146-a37b-2b4a6b9d55ef,updated_at=2022-09-25T00:56:54Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:54.411378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fcb09c0b-0fbe-4f08-bbf8-b7aa54eba39f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (9f0b331e-03a4-4a31-b1dd-2df555a68c25), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:54.413094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-fcb09c0b-0fbe-4f08-bbf8-b7aa54eba39f admin admin] Security group rule updated ['be7134f8-623c-4146-a37b-2b4a6b9d55ef'] Sep 25 00:56:54.415070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fcb09c0b-0fbe-4f08-bbf8-b7aa54eba39f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:54Z,description=,direction='egress',ethertype='IPv4',id=ed733426-5f34-4c93-811a-092a82615193,normalized_cidr=None,port_range_max=,port_range_min=,project_id='56d0ea5794f14f8d96f6b48d16fa108e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=be7134f8-623c-4146-a37b-2b4a6b9d55ef,updated_at=2022-09-25T00:56:54Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:54.416331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fcb09c0b-0fbe-4f08-bbf8-b7aa54eba39f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (ed733426-5f34-4c93-811a-092a82615193), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:54.416867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-fcb09c0b-0fbe-4f08-bbf8-b7aa54eba39f admin admin] Security group rule updated ['be7134f8-623c-4146-a37b-2b4a6b9d55ef'] Sep 25 00:56:54.660684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8f805707-9d7b-4152-ad2b-1a27c406b47e admin admin] Resource SecurityGroup deleted: be7134f8-623c-4146-a37b-2b4a6b9d55ef {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:54.661102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8f805707-9d7b-4152-ad2b-1a27c406b47e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (be7134f8-623c-4146-a37b-2b4a6b9d55ef), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:54.661743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f805707-9d7b-4152-ad2b-1a27c406b47e admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('be7134f8-623c-4146-a37b-2b4a6b9d55ef',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:56:54.676858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8f805707-9d7b-4152-ad2b-1a27c406b47e admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('be7134f8-623c-4146-a37b-2b4a6b9d55ef',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:56:54.677446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8f805707-9d7b-4152-ad2b-1a27c406b47e admin admin] Resource SecurityGroupRule deleted: 20f1f016-3e2d-448e-8ae0-4a35d6023d2a {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:54.678706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8f805707-9d7b-4152-ad2b-1a27c406b47e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (20f1f016-3e2d-448e-8ae0-4a35d6023d2a), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:54.679566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8f805707-9d7b-4152-ad2b-1a27c406b47e admin admin] Security group rule updated ['be7134f8-623c-4146-a37b-2b4a6b9d55ef'] Sep 25 00:56:54.680100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8f805707-9d7b-4152-ad2b-1a27c406b47e admin admin] Resource SecurityGroupRule deleted: 752a37b6-7d09-462b-becf-fd5560ccfaf5 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:54.680594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8f805707-9d7b-4152-ad2b-1a27c406b47e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (752a37b6-7d09-462b-becf-fd5560ccfaf5), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:54.681035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8f805707-9d7b-4152-ad2b-1a27c406b47e admin admin] Security group rule updated ['be7134f8-623c-4146-a37b-2b4a6b9d55ef'] Sep 25 00:56:54.681481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8f805707-9d7b-4152-ad2b-1a27c406b47e admin admin] Resource SecurityGroupRule deleted: 9f0b331e-03a4-4a31-b1dd-2df555a68c25 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:54.681962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8f805707-9d7b-4152-ad2b-1a27c406b47e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (9f0b331e-03a4-4a31-b1dd-2df555a68c25), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:54.682358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8f805707-9d7b-4152-ad2b-1a27c406b47e admin admin] Security group rule updated ['be7134f8-623c-4146-a37b-2b4a6b9d55ef'] Sep 25 00:56:54.682825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8f805707-9d7b-4152-ad2b-1a27c406b47e admin admin] Resource SecurityGroupRule deleted: ed733426-5f34-4c93-811a-092a82615193 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:54.683379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8f805707-9d7b-4152-ad2b-1a27c406b47e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (ed733426-5f34-4c93-811a-092a82615193), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:54.683867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8f805707-9d7b-4152-ad2b-1a27c406b47e admin admin] Security group rule updated ['be7134f8-623c-4146-a37b-2b4a6b9d55ef'] Sep 25 00:56:55.009507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-056005e0-c04b-4a98-aa94-3bd1c68ff4ed admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:54Z,description='Default security group',id=1c03f997-b07a-43e3-8f13-07bed615aa08,is_default=True,name='default',project_id='254d347551d748c3b8356d11a8e309c1',revision_number=1,rules=[SecurityGroupRule(336b4bdd-0c3f-48c0-8474-7d9e86105da1),SecurityGroupRule(7a11bc8e-52b5-4f46-b37b-72ab8146ac6f),SecurityGroupRule(be787dc3-0328-4d62-ab38-991b9a153870),SecurityGroupRule(fed61ac1-1f05-4467-adf0-80c72e9faf80)],shared=False,stateful=True,updated_at=2022-09-25T00:56:54Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:55.009507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-056005e0-c04b-4a98-aa94-3bd1c68ff4ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (1c03f997-b07a-43e3-8f13-07bed615aa08), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:55.012343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-056005e0-c04b-4a98-aa94-3bd1c68ff4ed admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:54Z,description=,direction='egress',ethertype='IPv6',id=336b4bdd-0c3f-48c0-8474-7d9e86105da1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='254d347551d748c3b8356d11a8e309c1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1c03f997-b07a-43e3-8f13-07bed615aa08,updated_at=2022-09-25T00:56:54Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:55.012343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-056005e0-c04b-4a98-aa94-3bd1c68ff4ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (336b4bdd-0c3f-48c0-8474-7d9e86105da1), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:55.012343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-056005e0-c04b-4a98-aa94-3bd1c68ff4ed admin admin] Security group rule updated ['1c03f997-b07a-43e3-8f13-07bed615aa08'] Sep 25 00:56:55.012636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-056005e0-c04b-4a98-aa94-3bd1c68ff4ed admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:54Z,description=,direction='ingress',ethertype='IPv6',id=7a11bc8e-52b5-4f46-b37b-72ab8146ac6f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='254d347551d748c3b8356d11a8e309c1',protocol=,remote_address_group_id=,remote_group_id=1c03f997-b07a-43e3-8f13-07bed615aa08,remote_ip_prefix=,revision_number=0,security_group_id=1c03f997-b07a-43e3-8f13-07bed615aa08,updated_at=2022-09-25T00:56:54Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:55.012737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-056005e0-c04b-4a98-aa94-3bd1c68ff4ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (7a11bc8e-52b5-4f46-b37b-72ab8146ac6f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:55.013033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-056005e0-c04b-4a98-aa94-3bd1c68ff4ed admin admin] Security group rule updated ['1c03f997-b07a-43e3-8f13-07bed615aa08'] Sep 25 00:56:55.016579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-056005e0-c04b-4a98-aa94-3bd1c68ff4ed admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:54Z,description=,direction='ingress',ethertype='IPv4',id=be787dc3-0328-4d62-ab38-991b9a153870,normalized_cidr=None,port_range_max=,port_range_min=,project_id='254d347551d748c3b8356d11a8e309c1',protocol=,remote_address_group_id=,remote_group_id=1c03f997-b07a-43e3-8f13-07bed615aa08,remote_ip_prefix=,revision_number=0,security_group_id=1c03f997-b07a-43e3-8f13-07bed615aa08,updated_at=2022-09-25T00:56:54Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:55.016837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-056005e0-c04b-4a98-aa94-3bd1c68ff4ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (be787dc3-0328-4d62-ab38-991b9a153870), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:55.017171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-056005e0-c04b-4a98-aa94-3bd1c68ff4ed admin admin] Security group rule updated ['1c03f997-b07a-43e3-8f13-07bed615aa08'] Sep 25 00:56:55.017923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-056005e0-c04b-4a98-aa94-3bd1c68ff4ed admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:54Z,description=,direction='egress',ethertype='IPv4',id=fed61ac1-1f05-4467-adf0-80c72e9faf80,normalized_cidr=None,port_range_max=,port_range_min=,project_id='254d347551d748c3b8356d11a8e309c1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1c03f997-b07a-43e3-8f13-07bed615aa08,updated_at=2022-09-25T00:56:54Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:55.018281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-056005e0-c04b-4a98-aa94-3bd1c68ff4ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (fed61ac1-1f05-4467-adf0-80c72e9faf80), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:55.018612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-056005e0-c04b-4a98-aa94-3bd1c68ff4ed admin admin] Security group rule updated ['1c03f997-b07a-43e3-8f13-07bed615aa08'] Sep 25 00:56:55.222914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-056005e0-c04b-4a98-aa94-3bd1c68ff4ed admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-25T00:56:54Z,description='',dns_domain=None,id=1435cc3d-9242-4a80-9d0b-c2f0cf952a66,mtu=1500,name='tempest-VolumesActionsTest-566370299-network',project_id='254d347551d748c3b8356d11a8e309c1',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(1435cc3d-9242-4a80-9d0b-c2f0cf952a66),segments=[NetworkSegment(6c0bb52c-8f01-4b43-b059-6591cb7e258f)],shared=False,status='ACTIVE',updated_at=2022-09-25T00:56:55Z,vlan_transparent=) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:55.223459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-056005e0-c04b-4a98-aa94-3bd1c68ff4ed admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (1435cc3d-9242-4a80-9d0b-c2f0cf952a66), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:55.363559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager [None req-056005e0-c04b-4a98-aa94-3bd1c68ff4ed admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 1435cc3d-9242-4a80-9d0b-c2f0cf952a66 with segmentation id not found. Sep 25 00:56:55.363559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 25 00:56:55.363559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 25 00:56:55.363559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 25 00:56:55.363559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 25 00:56:55.363559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 25 00:56:55.363559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 25 00:56:55.363559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 25 00:56:55.363559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 25 00:56:55.363559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 25 00:56:55.363559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 25 00:56:55.363559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 25 00:56:55.363559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 25 00:56:55.364663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 25 00:56:55.364663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 25 00:56:55.364663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 25 00:56:55.364663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 1435cc3d-9242-4a80-9d0b-c2f0cf952a66 with segmentation id not found. Sep 25 00:56:55.364663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Sep 25 00:56:55.612586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:282 started Sep 25 00:56:55.617595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834deed,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=342000000,duration_sec=578,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:55.618525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:56:55.619746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:282 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 00:56:55.840908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-07315ecb-e2cc-4534-a15b-2c698c9ddba3 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(7bee215e-d5e3-4aba-913a-2f202228e91c)],cidr=172.20.0.0/28,created_at=2022-09-25T00:56:55Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=b62565db-c94b-4d28-ad3c-a8a5b6d7602f,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-VolumesActionsTest-566370299-subnet',network_id=1435cc3d-9242-4a80-9d0b-c2f0cf952a66,project_id='254d347551d748c3b8356d11a8e309c1',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-25T00:56:55Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:55.841392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-07315ecb-e2cc-4534-a15b-2c698c9ddba3 admin admin] Publish callbacks [] for Subnet (b62565db-c94b-4d28-ad3c-a8a5b6d7602f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:55.972131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b97ade77-ff8a-48a2-9dfb-75b975d19f28 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:55Z,description='Default security group',id=84ab6963-757c-4407-b4dc-3f849d883a81,is_default=True,name='default',project_id='b61e2d35de03491fb4eea8e0c3789bf1',revision_number=1,rules=[SecurityGroupRule(1f1cc79f-5f1f-4237-8477-04dfa843ca03),SecurityGroupRule(3adfe653-f350-4e13-8cc7-664ccb0c7108),SecurityGroupRule(575a92f8-13ab-4749-b0a1-d8ed1748de65),SecurityGroupRule(e42cff41-fca1-4d7e-a517-2e6ee51900ed)],shared=False,stateful=True,updated_at=2022-09-25T00:56:55Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:55.973752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b97ade77-ff8a-48a2-9dfb-75b975d19f28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (84ab6963-757c-4407-b4dc-3f849d883a81), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:55.976638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b97ade77-ff8a-48a2-9dfb-75b975d19f28 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:55Z,description=,direction='egress',ethertype='IPv6',id=1f1cc79f-5f1f-4237-8477-04dfa843ca03,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b61e2d35de03491fb4eea8e0c3789bf1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=84ab6963-757c-4407-b4dc-3f849d883a81,updated_at=2022-09-25T00:56:55Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:55.977792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b97ade77-ff8a-48a2-9dfb-75b975d19f28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (1f1cc79f-5f1f-4237-8477-04dfa843ca03), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:55.978429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b97ade77-ff8a-48a2-9dfb-75b975d19f28 admin admin] Security group rule updated ['84ab6963-757c-4407-b4dc-3f849d883a81'] Sep 25 00:56:55.980335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b97ade77-ff8a-48a2-9dfb-75b975d19f28 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:55Z,description=,direction='ingress',ethertype='IPv6',id=3adfe653-f350-4e13-8cc7-664ccb0c7108,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b61e2d35de03491fb4eea8e0c3789bf1',protocol=,remote_address_group_id=,remote_group_id=84ab6963-757c-4407-b4dc-3f849d883a81,remote_ip_prefix=,revision_number=0,security_group_id=84ab6963-757c-4407-b4dc-3f849d883a81,updated_at=2022-09-25T00:56:55Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:55.980935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b97ade77-ff8a-48a2-9dfb-75b975d19f28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (3adfe653-f350-4e13-8cc7-664ccb0c7108), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:55.981843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b97ade77-ff8a-48a2-9dfb-75b975d19f28 admin admin] Security group rule updated ['84ab6963-757c-4407-b4dc-3f849d883a81'] Sep 25 00:56:55.983418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b97ade77-ff8a-48a2-9dfb-75b975d19f28 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:55Z,description=,direction='egress',ethertype='IPv4',id=575a92f8-13ab-4749-b0a1-d8ed1748de65,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b61e2d35de03491fb4eea8e0c3789bf1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=84ab6963-757c-4407-b4dc-3f849d883a81,updated_at=2022-09-25T00:56:55Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:55.984129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b97ade77-ff8a-48a2-9dfb-75b975d19f28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (575a92f8-13ab-4749-b0a1-d8ed1748de65), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:55.984610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b97ade77-ff8a-48a2-9dfb-75b975d19f28 admin admin] Security group rule updated ['84ab6963-757c-4407-b4dc-3f849d883a81'] Sep 25 00:56:55.986938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b97ade77-ff8a-48a2-9dfb-75b975d19f28 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:55Z,description=,direction='ingress',ethertype='IPv4',id=e42cff41-fca1-4d7e-a517-2e6ee51900ed,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b61e2d35de03491fb4eea8e0c3789bf1',protocol=,remote_address_group_id=,remote_group_id=84ab6963-757c-4407-b4dc-3f849d883a81,remote_ip_prefix=,revision_number=0,security_group_id=84ab6963-757c-4407-b4dc-3f849d883a81,updated_at=2022-09-25T00:56:55Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:55.987717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b97ade77-ff8a-48a2-9dfb-75b975d19f28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (e42cff41-fca1-4d7e-a517-2e6ee51900ed), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:55.988456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b97ade77-ff8a-48a2-9dfb-75b975d19f28 admin admin] Security group rule updated ['84ab6963-757c-4407-b4dc-3f849d883a81'] Sep 25 00:56:56.664825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-bb4bb631-780b-48ff-a41d-977e6d7a677b admin admin] Resource SecurityGroup deleted: 84ab6963-757c-4407-b4dc-3f849d883a81 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:56.666683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-bb4bb631-780b-48ff-a41d-977e6d7a677b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (84ab6963-757c-4407-b4dc-3f849d883a81), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:56.667180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb4bb631-780b-48ff-a41d-977e6d7a677b admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('84ab6963-757c-4407-b4dc-3f849d883a81',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:56:56.691266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-bb4bb631-780b-48ff-a41d-977e6d7a677b admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('84ab6963-757c-4407-b4dc-3f849d883a81',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:56:56.691757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-bb4bb631-780b-48ff-a41d-977e6d7a677b admin admin] Resource SecurityGroupRule deleted: 1f1cc79f-5f1f-4237-8477-04dfa843ca03 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:56.692134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-bb4bb631-780b-48ff-a41d-977e6d7a677b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (1f1cc79f-5f1f-4237-8477-04dfa843ca03), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:56.692470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-bb4bb631-780b-48ff-a41d-977e6d7a677b admin admin] Security group rule updated ['84ab6963-757c-4407-b4dc-3f849d883a81'] Sep 25 00:56:56.692871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-bb4bb631-780b-48ff-a41d-977e6d7a677b admin admin] Resource SecurityGroupRule deleted: 3adfe653-f350-4e13-8cc7-664ccb0c7108 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:56.693848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-bb4bb631-780b-48ff-a41d-977e6d7a677b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (3adfe653-f350-4e13-8cc7-664ccb0c7108), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:56.694171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-bb4bb631-780b-48ff-a41d-977e6d7a677b admin admin] Security group rule updated ['84ab6963-757c-4407-b4dc-3f849d883a81'] Sep 25 00:56:56.694553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-bb4bb631-780b-48ff-a41d-977e6d7a677b admin admin] Resource SecurityGroupRule deleted: 575a92f8-13ab-4749-b0a1-d8ed1748de65 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:56.694901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-bb4bb631-780b-48ff-a41d-977e6d7a677b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (575a92f8-13ab-4749-b0a1-d8ed1748de65), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:56.695221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-bb4bb631-780b-48ff-a41d-977e6d7a677b admin admin] Security group rule updated ['84ab6963-757c-4407-b4dc-3f849d883a81'] Sep 25 00:56:56.695595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-bb4bb631-780b-48ff-a41d-977e6d7a677b admin admin] Resource SecurityGroupRule deleted: e42cff41-fca1-4d7e-a517-2e6ee51900ed {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:56.695939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-bb4bb631-780b-48ff-a41d-977e6d7a677b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (e42cff41-fca1-4d7e-a517-2e6ee51900ed), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:56.696255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-bb4bb631-780b-48ff-a41d-977e6d7a677b admin admin] Security group rule updated ['84ab6963-757c-4407-b4dc-3f849d883a81'] Sep 25 00:56:57.618371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:283 started Sep 25 00:56:57.623369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834deef,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=347000000,duration_sec=580,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:57.624263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:56:57.624900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:283 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 25 00:56:58.687550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0a69e0a1-d784-4241-99bd-834bd6fd98dd admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:58Z,description='Default security group',id=d2e619f5-1e90-4a96-81e5-e4ae088df13d,is_default=True,name='default',project_id='7b7dff005bcf45ce9fb79fdc2b8eab52',revision_number=1,rules=[SecurityGroupRule(16890d05-39c5-434b-97e7-90074adb2480),SecurityGroupRule(1d453baa-0ce2-4925-901d-e964feb821aa),SecurityGroupRule(2f7dc441-c8ba-4519-a4f7-f2b5e3fc9b84),SecurityGroupRule(889cbcf1-f1d9-4579-9cd7-fba69b8cd01d)],shared=False,stateful=True,updated_at=2022-09-25T00:56:58Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:58.688234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0a69e0a1-d784-4241-99bd-834bd6fd98dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (d2e619f5-1e90-4a96-81e5-e4ae088df13d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:58.688736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0a69e0a1-d784-4241-99bd-834bd6fd98dd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:58Z,description=,direction='ingress',ethertype='IPv6',id=16890d05-39c5-434b-97e7-90074adb2480,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7b7dff005bcf45ce9fb79fdc2b8eab52',protocol=,remote_address_group_id=,remote_group_id=d2e619f5-1e90-4a96-81e5-e4ae088df13d,remote_ip_prefix=,revision_number=0,security_group_id=d2e619f5-1e90-4a96-81e5-e4ae088df13d,updated_at=2022-09-25T00:56:58Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:58.689107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0a69e0a1-d784-4241-99bd-834bd6fd98dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (16890d05-39c5-434b-97e7-90074adb2480), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:58.689472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-0a69e0a1-d784-4241-99bd-834bd6fd98dd admin admin] Security group rule updated ['d2e619f5-1e90-4a96-81e5-e4ae088df13d'] Sep 25 00:56:58.690266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0a69e0a1-d784-4241-99bd-834bd6fd98dd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:58Z,description=,direction='egress',ethertype='IPv4',id=1d453baa-0ce2-4925-901d-e964feb821aa,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7b7dff005bcf45ce9fb79fdc2b8eab52',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d2e619f5-1e90-4a96-81e5-e4ae088df13d,updated_at=2022-09-25T00:56:58Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:58.690631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0a69e0a1-d784-4241-99bd-834bd6fd98dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (1d453baa-0ce2-4925-901d-e964feb821aa), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:58.690964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-0a69e0a1-d784-4241-99bd-834bd6fd98dd admin admin] Security group rule updated ['d2e619f5-1e90-4a96-81e5-e4ae088df13d'] Sep 25 00:56:58.691631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0a69e0a1-d784-4241-99bd-834bd6fd98dd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:58Z,description=,direction='egress',ethertype='IPv6',id=2f7dc441-c8ba-4519-a4f7-f2b5e3fc9b84,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7b7dff005bcf45ce9fb79fdc2b8eab52',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d2e619f5-1e90-4a96-81e5-e4ae088df13d,updated_at=2022-09-25T00:56:58Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:58.691992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0a69e0a1-d784-4241-99bd-834bd6fd98dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (2f7dc441-c8ba-4519-a4f7-f2b5e3fc9b84), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:58.695117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-0a69e0a1-d784-4241-99bd-834bd6fd98dd admin admin] Security group rule updated ['d2e619f5-1e90-4a96-81e5-e4ae088df13d'] Sep 25 00:56:58.695925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0a69e0a1-d784-4241-99bd-834bd6fd98dd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:58Z,description=,direction='ingress',ethertype='IPv4',id=889cbcf1-f1d9-4579-9cd7-fba69b8cd01d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7b7dff005bcf45ce9fb79fdc2b8eab52',protocol=,remote_address_group_id=,remote_group_id=d2e619f5-1e90-4a96-81e5-e4ae088df13d,remote_ip_prefix=,revision_number=0,security_group_id=d2e619f5-1e90-4a96-81e5-e4ae088df13d,updated_at=2022-09-25T00:56:58Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:56:58.698327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0a69e0a1-d784-4241-99bd-834bd6fd98dd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (889cbcf1-f1d9-4579-9cd7-fba69b8cd01d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:58.705175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-0a69e0a1-d784-4241-99bd-834bd6fd98dd admin admin] Security group rule updated ['d2e619f5-1e90-4a96-81e5-e4ae088df13d'] Sep 25 00:56:58.971066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b073fce6-dd80-4f40-9d7a-ae01169572e7 admin admin] Resource SecurityGroup deleted: d2e619f5-1e90-4a96-81e5-e4ae088df13d {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:58.971501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b073fce6-dd80-4f40-9d7a-ae01169572e7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (d2e619f5-1e90-4a96-81e5-e4ae088df13d), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:58.972016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b073fce6-dd80-4f40-9d7a-ae01169572e7 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('d2e619f5-1e90-4a96-81e5-e4ae088df13d',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:56:58.998579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b073fce6-dd80-4f40-9d7a-ae01169572e7 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('d2e619f5-1e90-4a96-81e5-e4ae088df13d',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:56:58.999075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b073fce6-dd80-4f40-9d7a-ae01169572e7 admin admin] Resource SecurityGroupRule deleted: 16890d05-39c5-434b-97e7-90074adb2480 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:59.000232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b073fce6-dd80-4f40-9d7a-ae01169572e7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (16890d05-39c5-434b-97e7-90074adb2480), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:59.001459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b073fce6-dd80-4f40-9d7a-ae01169572e7 admin admin] Security group rule updated ['d2e619f5-1e90-4a96-81e5-e4ae088df13d'] Sep 25 00:56:59.002564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b073fce6-dd80-4f40-9d7a-ae01169572e7 admin admin] Resource SecurityGroupRule deleted: 1d453baa-0ce2-4925-901d-e964feb821aa {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:59.003437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b073fce6-dd80-4f40-9d7a-ae01169572e7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (1d453baa-0ce2-4925-901d-e964feb821aa), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:59.004345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b073fce6-dd80-4f40-9d7a-ae01169572e7 admin admin] Security group rule updated ['d2e619f5-1e90-4a96-81e5-e4ae088df13d'] Sep 25 00:56:59.005074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b073fce6-dd80-4f40-9d7a-ae01169572e7 admin admin] Resource SecurityGroupRule deleted: 2f7dc441-c8ba-4519-a4f7-f2b5e3fc9b84 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:59.006315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b073fce6-dd80-4f40-9d7a-ae01169572e7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (2f7dc441-c8ba-4519-a4f7-f2b5e3fc9b84), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:59.006874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b073fce6-dd80-4f40-9d7a-ae01169572e7 admin admin] Security group rule updated ['d2e619f5-1e90-4a96-81e5-e4ae088df13d'] Sep 25 00:56:59.007778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b073fce6-dd80-4f40-9d7a-ae01169572e7 admin admin] Resource SecurityGroupRule deleted: 889cbcf1-f1d9-4579-9cd7-fba69b8cd01d {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:56:59.008373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b073fce6-dd80-4f40-9d7a-ae01169572e7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (889cbcf1-f1d9-4579-9cd7-fba69b8cd01d), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:56:59.008970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b073fce6-dd80-4f40-9d7a-ae01169572e7 admin admin] Security group rule updated ['d2e619f5-1e90-4a96-81e5-e4ae088df13d'] Sep 25 00:56:59.616755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:284 started Sep 25 00:56:59.619838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834def1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=345000000,duration_sec=582,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:56:59.620468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:56:59.620829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:284 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:57:00.082829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-22a0b061-7c0c-4f28-8c57-2fcc98a423d0 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:56:59Z,description='Default security group',id=db734c00-2138-48ee-9a8b-005ad83b0afd,is_default=True,name='default',project_id='9a328183e0224b7498ff5c7f3b1b0980',revision_number=1,rules=[SecurityGroupRule(147f633c-d327-4c13-a1f1-074b9d886bec),SecurityGroupRule(37d092e5-b526-420c-bde2-582bc985a007),SecurityGroupRule(9eafd6ec-e531-4288-956b-6ee6b0a82fdc),SecurityGroupRule(c9aa6d09-da99-47c6-8474-099c39b97b30)],shared=False,stateful=True,updated_at=2022-09-25T00:56:59Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:00.083446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-22a0b061-7c0c-4f28-8c57-2fcc98a423d0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (db734c00-2138-48ee-9a8b-005ad83b0afd), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:00.084775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-22a0b061-7c0c-4f28-8c57-2fcc98a423d0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:59Z,description=,direction='ingress',ethertype='IPv4',id=147f633c-d327-4c13-a1f1-074b9d886bec,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9a328183e0224b7498ff5c7f3b1b0980',protocol=,remote_address_group_id=,remote_group_id=db734c00-2138-48ee-9a8b-005ad83b0afd,remote_ip_prefix=,revision_number=0,security_group_id=db734c00-2138-48ee-9a8b-005ad83b0afd,updated_at=2022-09-25T00:56:59Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:00.085150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-22a0b061-7c0c-4f28-8c57-2fcc98a423d0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (147f633c-d327-4c13-a1f1-074b9d886bec), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:00.085533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-22a0b061-7c0c-4f28-8c57-2fcc98a423d0 admin admin] Security group rule updated ['db734c00-2138-48ee-9a8b-005ad83b0afd'] Sep 25 00:57:00.086367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-22a0b061-7c0c-4f28-8c57-2fcc98a423d0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:59Z,description=,direction='egress',ethertype='IPv6',id=37d092e5-b526-420c-bde2-582bc985a007,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9a328183e0224b7498ff5c7f3b1b0980',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=db734c00-2138-48ee-9a8b-005ad83b0afd,updated_at=2022-09-25T00:56:59Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:00.086719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-22a0b061-7c0c-4f28-8c57-2fcc98a423d0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (37d092e5-b526-420c-bde2-582bc985a007), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:00.087134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-22a0b061-7c0c-4f28-8c57-2fcc98a423d0 admin admin] Security group rule updated ['db734c00-2138-48ee-9a8b-005ad83b0afd'] Sep 25 00:57:00.087844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-22a0b061-7c0c-4f28-8c57-2fcc98a423d0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:59Z,description=,direction='egress',ethertype='IPv4',id=9eafd6ec-e531-4288-956b-6ee6b0a82fdc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9a328183e0224b7498ff5c7f3b1b0980',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=db734c00-2138-48ee-9a8b-005ad83b0afd,updated_at=2022-09-25T00:56:59Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:00.088207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-22a0b061-7c0c-4f28-8c57-2fcc98a423d0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (9eafd6ec-e531-4288-956b-6ee6b0a82fdc), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:00.088536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-22a0b061-7c0c-4f28-8c57-2fcc98a423d0 admin admin] Security group rule updated ['db734c00-2138-48ee-9a8b-005ad83b0afd'] Sep 25 00:57:00.089203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-22a0b061-7c0c-4f28-8c57-2fcc98a423d0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:56:59Z,description=,direction='ingress',ethertype='IPv6',id=c9aa6d09-da99-47c6-8474-099c39b97b30,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9a328183e0224b7498ff5c7f3b1b0980',protocol=,remote_address_group_id=,remote_group_id=db734c00-2138-48ee-9a8b-005ad83b0afd,remote_ip_prefix=,revision_number=0,security_group_id=db734c00-2138-48ee-9a8b-005ad83b0afd,updated_at=2022-09-25T00:56:59Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:00.089583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-22a0b061-7c0c-4f28-8c57-2fcc98a423d0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (c9aa6d09-da99-47c6-8474-099c39b97b30), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:00.089911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-22a0b061-7c0c-4f28-8c57-2fcc98a423d0 admin admin] Security group rule updated ['db734c00-2138-48ee-9a8b-005ad83b0afd'] Sep 25 00:57:00.327106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-561bfa25-2695-4735-b652-33eee0fac323 admin admin] Resource SecurityGroup deleted: db734c00-2138-48ee-9a8b-005ad83b0afd {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:00.327658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-561bfa25-2695-4735-b652-33eee0fac323 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (db734c00-2138-48ee-9a8b-005ad83b0afd), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:00.328113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-561bfa25-2695-4735-b652-33eee0fac323 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('db734c00-2138-48ee-9a8b-005ad83b0afd',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:57:00.345091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-561bfa25-2695-4735-b652-33eee0fac323 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('db734c00-2138-48ee-9a8b-005ad83b0afd',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:57:00.345603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-561bfa25-2695-4735-b652-33eee0fac323 admin admin] Resource SecurityGroupRule deleted: 147f633c-d327-4c13-a1f1-074b9d886bec {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:00.346186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-561bfa25-2695-4735-b652-33eee0fac323 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (147f633c-d327-4c13-a1f1-074b9d886bec), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:00.346573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-561bfa25-2695-4735-b652-33eee0fac323 admin admin] Security group rule updated ['db734c00-2138-48ee-9a8b-005ad83b0afd'] Sep 25 00:57:00.346966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-561bfa25-2695-4735-b652-33eee0fac323 admin admin] Resource SecurityGroupRule deleted: 37d092e5-b526-420c-bde2-582bc985a007 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:00.347311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-561bfa25-2695-4735-b652-33eee0fac323 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (37d092e5-b526-420c-bde2-582bc985a007), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:00.347629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-561bfa25-2695-4735-b652-33eee0fac323 admin admin] Security group rule updated ['db734c00-2138-48ee-9a8b-005ad83b0afd'] Sep 25 00:57:00.347997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-561bfa25-2695-4735-b652-33eee0fac323 admin admin] Resource SecurityGroupRule deleted: 9eafd6ec-e531-4288-956b-6ee6b0a82fdc {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:00.348330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-561bfa25-2695-4735-b652-33eee0fac323 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (9eafd6ec-e531-4288-956b-6ee6b0a82fdc), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:00.348829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-561bfa25-2695-4735-b652-33eee0fac323 admin admin] Security group rule updated ['db734c00-2138-48ee-9a8b-005ad83b0afd'] Sep 25 00:57:00.349889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-561bfa25-2695-4735-b652-33eee0fac323 admin admin] Resource SecurityGroupRule deleted: c9aa6d09-da99-47c6-8474-099c39b97b30 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:00.350977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-561bfa25-2695-4735-b652-33eee0fac323 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (c9aa6d09-da99-47c6-8474-099c39b97b30), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:00.351445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-561bfa25-2695-4735-b652-33eee0fac323 admin admin] Security group rule updated ['db734c00-2138-48ee-9a8b-005ad83b0afd'] Sep 25 00:57:01.617562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:285 started Sep 25 00:57:01.620922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834def3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=347000000,duration_sec=584,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:01.622583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:57:01.622948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:285 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 00:57:03.618146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:286 started Sep 25 00:57:03.620559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834def5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=346000000,duration_sec=586,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:03.621152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:57:03.621513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:286 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:57:05.618995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:287 started Sep 25 00:57:05.623393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834def7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=348000000,duration_sec=588,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:05.624110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:57:05.624557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:287 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 00:57:07.098257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9bf30165-5ab4-490a-adfe-4ac542763159 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:57:06Z,description='Default security group',id=d4e09020-9abf-4155-a6e0-b9da2aaa4e51,is_default=True,name='default',project_id='4bccc5e412f848b3957c110e731c309d',revision_number=1,rules=[SecurityGroupRule(38e66c2f-2cb8-4e33-9967-52842520ada7),SecurityGroupRule(69c3fd67-08c8-498f-80ca-1a600a41f43b),SecurityGroupRule(e5c31779-c514-4ca4-ad54-b7c0a167877a),SecurityGroupRule(fa5ec390-8390-4442-b6b6-6b13c4148113)],shared=False,stateful=True,updated_at=2022-09-25T00:57:06Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:07.098915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9bf30165-5ab4-490a-adfe-4ac542763159 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (d4e09020-9abf-4155-a6e0-b9da2aaa4e51), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:07.100901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9bf30165-5ab4-490a-adfe-4ac542763159 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:07Z,description=,direction='egress',ethertype='IPv6',id=38e66c2f-2cb8-4e33-9967-52842520ada7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4bccc5e412f848b3957c110e731c309d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d4e09020-9abf-4155-a6e0-b9da2aaa4e51,updated_at=2022-09-25T00:57:07Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:07.101762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9bf30165-5ab4-490a-adfe-4ac542763159 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (38e66c2f-2cb8-4e33-9967-52842520ada7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:07.102584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9bf30165-5ab4-490a-adfe-4ac542763159 admin admin] Security group rule updated ['d4e09020-9abf-4155-a6e0-b9da2aaa4e51'] Sep 25 00:57:07.103328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9bf30165-5ab4-490a-adfe-4ac542763159 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:06Z,description=,direction='ingress',ethertype='IPv4',id=69c3fd67-08c8-498f-80ca-1a600a41f43b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4bccc5e412f848b3957c110e731c309d',protocol=,remote_address_group_id=,remote_group_id=d4e09020-9abf-4155-a6e0-b9da2aaa4e51,remote_ip_prefix=,revision_number=0,security_group_id=d4e09020-9abf-4155-a6e0-b9da2aaa4e51,updated_at=2022-09-25T00:57:06Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:07.104011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9bf30165-5ab4-490a-adfe-4ac542763159 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (69c3fd67-08c8-498f-80ca-1a600a41f43b), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:07.104398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9bf30165-5ab4-490a-adfe-4ac542763159 admin admin] Security group rule updated ['d4e09020-9abf-4155-a6e0-b9da2aaa4e51'] Sep 25 00:57:07.105729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9bf30165-5ab4-490a-adfe-4ac542763159 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:06Z,description=,direction='egress',ethertype='IPv4',id=e5c31779-c514-4ca4-ad54-b7c0a167877a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4bccc5e412f848b3957c110e731c309d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d4e09020-9abf-4155-a6e0-b9da2aaa4e51,updated_at=2022-09-25T00:57:06Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:07.106280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9bf30165-5ab4-490a-adfe-4ac542763159 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (e5c31779-c514-4ca4-ad54-b7c0a167877a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:07.106473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9bf30165-5ab4-490a-adfe-4ac542763159 admin admin] Security group rule updated ['d4e09020-9abf-4155-a6e0-b9da2aaa4e51'] Sep 25 00:57:07.107760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9bf30165-5ab4-490a-adfe-4ac542763159 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:06Z,description=,direction='ingress',ethertype='IPv6',id=fa5ec390-8390-4442-b6b6-6b13c4148113,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4bccc5e412f848b3957c110e731c309d',protocol=,remote_address_group_id=,remote_group_id=d4e09020-9abf-4155-a6e0-b9da2aaa4e51,remote_ip_prefix=,revision_number=0,security_group_id=d4e09020-9abf-4155-a6e0-b9da2aaa4e51,updated_at=2022-09-25T00:57:06Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:07.108673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9bf30165-5ab4-490a-adfe-4ac542763159 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (fa5ec390-8390-4442-b6b6-6b13c4148113), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:07.109504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9bf30165-5ab4-490a-adfe-4ac542763159 admin admin] Security group rule updated ['d4e09020-9abf-4155-a6e0-b9da2aaa4e51'] Sep 25 00:57:07.243786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3573a49b-bbda-4570-a253-a98e3ce16715 admin admin] Resource SecurityGroup deleted: d4e09020-9abf-4155-a6e0-b9da2aaa4e51 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:07.244220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3573a49b-bbda-4570-a253-a98e3ce16715 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (d4e09020-9abf-4155-a6e0-b9da2aaa4e51), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:07.244686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3573a49b-bbda-4570-a253-a98e3ce16715 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('d4e09020-9abf-4155-a6e0-b9da2aaa4e51',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:57:07.260145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3573a49b-bbda-4570-a253-a98e3ce16715 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('d4e09020-9abf-4155-a6e0-b9da2aaa4e51',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:57:07.260908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3573a49b-bbda-4570-a253-a98e3ce16715 admin admin] Resource SecurityGroupRule deleted: 38e66c2f-2cb8-4e33-9967-52842520ada7 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:07.261383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3573a49b-bbda-4570-a253-a98e3ce16715 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (38e66c2f-2cb8-4e33-9967-52842520ada7), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:07.261897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-3573a49b-bbda-4570-a253-a98e3ce16715 admin admin] Security group rule updated ['d4e09020-9abf-4155-a6e0-b9da2aaa4e51'] Sep 25 00:57:07.263133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3573a49b-bbda-4570-a253-a98e3ce16715 admin admin] Resource SecurityGroupRule deleted: 69c3fd67-08c8-498f-80ca-1a600a41f43b {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:07.263690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3573a49b-bbda-4570-a253-a98e3ce16715 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (69c3fd67-08c8-498f-80ca-1a600a41f43b), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:07.264448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-3573a49b-bbda-4570-a253-a98e3ce16715 admin admin] Security group rule updated ['d4e09020-9abf-4155-a6e0-b9da2aaa4e51'] Sep 25 00:57:07.265013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3573a49b-bbda-4570-a253-a98e3ce16715 admin admin] Resource SecurityGroupRule deleted: e5c31779-c514-4ca4-ad54-b7c0a167877a {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:07.265587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3573a49b-bbda-4570-a253-a98e3ce16715 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (e5c31779-c514-4ca4-ad54-b7c0a167877a), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:07.266128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-3573a49b-bbda-4570-a253-a98e3ce16715 admin admin] Security group rule updated ['d4e09020-9abf-4155-a6e0-b9da2aaa4e51'] Sep 25 00:57:07.266720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3573a49b-bbda-4570-a253-a98e3ce16715 admin admin] Resource SecurityGroupRule deleted: fa5ec390-8390-4442-b6b6-6b13c4148113 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:07.267099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3573a49b-bbda-4570-a253-a98e3ce16715 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (fa5ec390-8390-4442-b6b6-6b13c4148113), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:07.267510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-3573a49b-bbda-4570-a253-a98e3ce16715 admin admin] Security group rule updated ['d4e09020-9abf-4155-a6e0-b9da2aaa4e51'] Sep 25 00:57:07.620127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:288 started Sep 25 00:57:07.623132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834def9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=348000000,duration_sec=590,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:07.628419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:57:07.628746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:288 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 25 00:57:07.633715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7946b636-f481-458d-9300-3b3945cf590e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:57:07Z,description='Default security group',id=31d684d5-0bf0-4f66-987e-e19a0c44be09,is_default=True,name='default',project_id='ba896797e1ca468dbfaeca0b414589c8',revision_number=1,rules=[SecurityGroupRule(1ec4047c-c88f-4dd4-b64c-265eeac2bebe),SecurityGroupRule(c16758ff-b645-4136-828f-bdda9b8cb248),SecurityGroupRule(c7ae5d20-854b-472b-b3c0-e3eb01366a33),SecurityGroupRule(e9802d37-7a4d-4f5a-a884-8cecb39674ad)],shared=False,stateful=True,updated_at=2022-09-25T00:57:07Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:07.634137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7946b636-f481-458d-9300-3b3945cf590e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (31d684d5-0bf0-4f66-987e-e19a0c44be09), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:07.634947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7946b636-f481-458d-9300-3b3945cf590e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:07Z,description=,direction='egress',ethertype='IPv4',id=1ec4047c-c88f-4dd4-b64c-265eeac2bebe,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ba896797e1ca468dbfaeca0b414589c8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=31d684d5-0bf0-4f66-987e-e19a0c44be09,updated_at=2022-09-25T00:57:07Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:07.635480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7946b636-f481-458d-9300-3b3945cf590e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (1ec4047c-c88f-4dd4-b64c-265eeac2bebe), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:07.636153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-7946b636-f481-458d-9300-3b3945cf590e admin admin] Security group rule updated ['31d684d5-0bf0-4f66-987e-e19a0c44be09'] Sep 25 00:57:07.637051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7946b636-f481-458d-9300-3b3945cf590e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:07Z,description=,direction='ingress',ethertype='IPv4',id=c16758ff-b645-4136-828f-bdda9b8cb248,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ba896797e1ca468dbfaeca0b414589c8',protocol=,remote_address_group_id=,remote_group_id=31d684d5-0bf0-4f66-987e-e19a0c44be09,remote_ip_prefix=,revision_number=0,security_group_id=31d684d5-0bf0-4f66-987e-e19a0c44be09,updated_at=2022-09-25T00:57:07Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:07.637637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7946b636-f481-458d-9300-3b3945cf590e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (c16758ff-b645-4136-828f-bdda9b8cb248), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:07.638158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-7946b636-f481-458d-9300-3b3945cf590e admin admin] Security group rule updated ['31d684d5-0bf0-4f66-987e-e19a0c44be09'] Sep 25 00:57:07.639002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7946b636-f481-458d-9300-3b3945cf590e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:07Z,description=,direction='egress',ethertype='IPv6',id=c7ae5d20-854b-472b-b3c0-e3eb01366a33,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ba896797e1ca468dbfaeca0b414589c8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=31d684d5-0bf0-4f66-987e-e19a0c44be09,updated_at=2022-09-25T00:57:07Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:07.639579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7946b636-f481-458d-9300-3b3945cf590e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (c7ae5d20-854b-472b-b3c0-e3eb01366a33), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:07.640088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-7946b636-f481-458d-9300-3b3945cf590e admin admin] Security group rule updated ['31d684d5-0bf0-4f66-987e-e19a0c44be09'] Sep 25 00:57:07.640943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7946b636-f481-458d-9300-3b3945cf590e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:07Z,description=,direction='ingress',ethertype='IPv6',id=e9802d37-7a4d-4f5a-a884-8cecb39674ad,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ba896797e1ca468dbfaeca0b414589c8',protocol=,remote_address_group_id=,remote_group_id=31d684d5-0bf0-4f66-987e-e19a0c44be09,remote_ip_prefix=,revision_number=0,security_group_id=31d684d5-0bf0-4f66-987e-e19a0c44be09,updated_at=2022-09-25T00:57:07Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:07.641517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7946b636-f481-458d-9300-3b3945cf590e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (e9802d37-7a4d-4f5a-a884-8cecb39674ad), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:07.642044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-7946b636-f481-458d-9300-3b3945cf590e admin admin] Security group rule updated ['31d684d5-0bf0-4f66-987e-e19a0c44be09'] Sep 25 00:57:07.729666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-bb1bc53e-9689-4247-b25f-7a1d2a36c8c5 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:57:07Z,description='Default security group',id=b411880c-e4c2-4b19-982d-b6f6221db224,is_default=True,name='default',project_id='d410822d4a0e49029e0d62cab39bbd45',revision_number=1,rules=[SecurityGroupRule(365458a4-703b-4b14-a8c7-b7b8d280b8e7),SecurityGroupRule(6ce533b2-8eec-4e1d-a451-8c16a052c36f),SecurityGroupRule(a07e9bf4-48a1-410d-b6b1-ec192d9eac1f),SecurityGroupRule(a28db82b-034e-4908-b029-707b734d65e9)],shared=False,stateful=True,updated_at=2022-09-25T00:57:07Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:07.730053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-bb1bc53e-9689-4247-b25f-7a1d2a36c8c5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (b411880c-e4c2-4b19-982d-b6f6221db224), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:07.731446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-bb1bc53e-9689-4247-b25f-7a1d2a36c8c5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:07Z,description=,direction='egress',ethertype='IPv6',id=365458a4-703b-4b14-a8c7-b7b8d280b8e7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d410822d4a0e49029e0d62cab39bbd45',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b411880c-e4c2-4b19-982d-b6f6221db224,updated_at=2022-09-25T00:57:07Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:07.731886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-bb1bc53e-9689-4247-b25f-7a1d2a36c8c5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (365458a4-703b-4b14-a8c7-b7b8d280b8e7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:07.732225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-bb1bc53e-9689-4247-b25f-7a1d2a36c8c5 admin admin] Security group rule updated ['b411880c-e4c2-4b19-982d-b6f6221db224'] Sep 25 00:57:07.733486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-bb1bc53e-9689-4247-b25f-7a1d2a36c8c5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:07Z,description=,direction='egress',ethertype='IPv4',id=6ce533b2-8eec-4e1d-a451-8c16a052c36f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d410822d4a0e49029e0d62cab39bbd45',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b411880c-e4c2-4b19-982d-b6f6221db224,updated_at=2022-09-25T00:57:07Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:07.734065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-bb1bc53e-9689-4247-b25f-7a1d2a36c8c5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (6ce533b2-8eec-4e1d-a451-8c16a052c36f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:07.734521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-bb1bc53e-9689-4247-b25f-7a1d2a36c8c5 admin admin] Security group rule updated ['b411880c-e4c2-4b19-982d-b6f6221db224'] Sep 25 00:57:07.735203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-bb1bc53e-9689-4247-b25f-7a1d2a36c8c5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:07Z,description=,direction='ingress',ethertype='IPv4',id=a07e9bf4-48a1-410d-b6b1-ec192d9eac1f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d410822d4a0e49029e0d62cab39bbd45',protocol=,remote_address_group_id=,remote_group_id=b411880c-e4c2-4b19-982d-b6f6221db224,remote_ip_prefix=,revision_number=0,security_group_id=b411880c-e4c2-4b19-982d-b6f6221db224,updated_at=2022-09-25T00:57:07Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:07.735562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-bb1bc53e-9689-4247-b25f-7a1d2a36c8c5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (a07e9bf4-48a1-410d-b6b1-ec192d9eac1f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:07.735892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-bb1bc53e-9689-4247-b25f-7a1d2a36c8c5 admin admin] Security group rule updated ['b411880c-e4c2-4b19-982d-b6f6221db224'] Sep 25 00:57:07.737017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-bb1bc53e-9689-4247-b25f-7a1d2a36c8c5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:07Z,description=,direction='ingress',ethertype='IPv6',id=a28db82b-034e-4908-b029-707b734d65e9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d410822d4a0e49029e0d62cab39bbd45',protocol=,remote_address_group_id=,remote_group_id=b411880c-e4c2-4b19-982d-b6f6221db224,remote_ip_prefix=,revision_number=0,security_group_id=b411880c-e4c2-4b19-982d-b6f6221db224,updated_at=2022-09-25T00:57:07Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:07.737541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-bb1bc53e-9689-4247-b25f-7a1d2a36c8c5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (a28db82b-034e-4908-b029-707b734d65e9), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:07.738145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-bb1bc53e-9689-4247-b25f-7a1d2a36c8c5 admin admin] Security group rule updated ['b411880c-e4c2-4b19-982d-b6f6221db224'] Sep 25 00:57:07.783431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d9a33157-04f6-4ffc-a642-979727892628 admin admin] Resource SecurityGroup deleted: 31d684d5-0bf0-4f66-987e-e19a0c44be09 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:07.783912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d9a33157-04f6-4ffc-a642-979727892628 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (31d684d5-0bf0-4f66-987e-e19a0c44be09), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:07.784615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9a33157-04f6-4ffc-a642-979727892628 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('31d684d5-0bf0-4f66-987e-e19a0c44be09',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:57:07.804987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d9a33157-04f6-4ffc-a642-979727892628 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('31d684d5-0bf0-4f66-987e-e19a0c44be09',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:57:07.805802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d9a33157-04f6-4ffc-a642-979727892628 admin admin] Resource SecurityGroupRule deleted: 1ec4047c-c88f-4dd4-b64c-265eeac2bebe {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:07.806233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d9a33157-04f6-4ffc-a642-979727892628 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (1ec4047c-c88f-4dd4-b64c-265eeac2bebe), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:07.806635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d9a33157-04f6-4ffc-a642-979727892628 admin admin] Security group rule updated ['31d684d5-0bf0-4f66-987e-e19a0c44be09'] Sep 25 00:57:07.807099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d9a33157-04f6-4ffc-a642-979727892628 admin admin] Resource SecurityGroupRule deleted: c16758ff-b645-4136-828f-bdda9b8cb248 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:07.807503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d9a33157-04f6-4ffc-a642-979727892628 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (c16758ff-b645-4136-828f-bdda9b8cb248), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:07.807901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d9a33157-04f6-4ffc-a642-979727892628 admin admin] Security group rule updated ['31d684d5-0bf0-4f66-987e-e19a0c44be09'] Sep 25 00:57:07.808346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d9a33157-04f6-4ffc-a642-979727892628 admin admin] Resource SecurityGroupRule deleted: c7ae5d20-854b-472b-b3c0-e3eb01366a33 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:07.808931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d9a33157-04f6-4ffc-a642-979727892628 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (c7ae5d20-854b-472b-b3c0-e3eb01366a33), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:07.809308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d9a33157-04f6-4ffc-a642-979727892628 admin admin] Security group rule updated ['31d684d5-0bf0-4f66-987e-e19a0c44be09'] Sep 25 00:57:07.809683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d9a33157-04f6-4ffc-a642-979727892628 admin admin] Resource SecurityGroupRule deleted: e9802d37-7a4d-4f5a-a884-8cecb39674ad {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:07.810026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d9a33157-04f6-4ffc-a642-979727892628 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (e9802d37-7a4d-4f5a-a884-8cecb39674ad), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:07.810344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d9a33157-04f6-4ffc-a642-979727892628 admin admin] Security group rule updated ['31d684d5-0bf0-4f66-987e-e19a0c44be09'] Sep 25 00:57:07.885092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-33f057a5-ab1a-4d9e-8775-c0a06c5c4ead admin admin] Resource SecurityGroup deleted: b411880c-e4c2-4b19-982d-b6f6221db224 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:07.885943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-33f057a5-ab1a-4d9e-8775-c0a06c5c4ead admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (b411880c-e4c2-4b19-982d-b6f6221db224), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:07.886917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33f057a5-ab1a-4d9e-8775-c0a06c5c4ead admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('b411880c-e4c2-4b19-982d-b6f6221db224',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:57:07.902122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-33f057a5-ab1a-4d9e-8775-c0a06c5c4ead admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('b411880c-e4c2-4b19-982d-b6f6221db224',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:57:07.902818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-33f057a5-ab1a-4d9e-8775-c0a06c5c4ead admin admin] Resource SecurityGroupRule deleted: 365458a4-703b-4b14-a8c7-b7b8d280b8e7 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:07.903332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-33f057a5-ab1a-4d9e-8775-c0a06c5c4ead admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (365458a4-703b-4b14-a8c7-b7b8d280b8e7), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:07.903836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-33f057a5-ab1a-4d9e-8775-c0a06c5c4ead admin admin] Security group rule updated ['b411880c-e4c2-4b19-982d-b6f6221db224'] Sep 25 00:57:07.904682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-33f057a5-ab1a-4d9e-8775-c0a06c5c4ead admin admin] Resource SecurityGroupRule deleted: 6ce533b2-8eec-4e1d-a451-8c16a052c36f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:07.905421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-33f057a5-ab1a-4d9e-8775-c0a06c5c4ead admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (6ce533b2-8eec-4e1d-a451-8c16a052c36f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:07.905699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-33f057a5-ab1a-4d9e-8775-c0a06c5c4ead admin admin] Security group rule updated ['b411880c-e4c2-4b19-982d-b6f6221db224'] Sep 25 00:57:07.906215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-33f057a5-ab1a-4d9e-8775-c0a06c5c4ead admin admin] Resource SecurityGroupRule deleted: a07e9bf4-48a1-410d-b6b1-ec192d9eac1f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:07.906843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-33f057a5-ab1a-4d9e-8775-c0a06c5c4ead admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (a07e9bf4-48a1-410d-b6b1-ec192d9eac1f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:07.907284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-33f057a5-ab1a-4d9e-8775-c0a06c5c4ead admin admin] Security group rule updated ['b411880c-e4c2-4b19-982d-b6f6221db224'] Sep 25 00:57:07.907787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-33f057a5-ab1a-4d9e-8775-c0a06c5c4ead admin admin] Resource SecurityGroupRule deleted: a28db82b-034e-4908-b029-707b734d65e9 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:07.908262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-33f057a5-ab1a-4d9e-8775-c0a06c5c4ead admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (a28db82b-034e-4908-b029-707b734d65e9), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:07.908881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-33f057a5-ab1a-4d9e-8775-c0a06c5c4ead admin admin] Security group rule updated ['b411880c-e4c2-4b19-982d-b6f6221db224'] Sep 25 00:57:08.490380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a437b4ee-1a85-4bcb-a946-c9ab0318509c admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:57:08Z,description='Default security group',id=beb36863-8128-4c44-acb6-d9b1d711e507,is_default=True,name='default',project_id='1fba20633c144fe0a8572d2a2343f8c9',revision_number=1,rules=[SecurityGroupRule(1182087a-45a7-4da4-ba0c-33d813d59c33),SecurityGroupRule(3b5ac9fa-eace-4020-a943-3a9f21f33f88),SecurityGroupRule(5c51a24b-045e-479d-9ce2-afa982faa453),SecurityGroupRule(9d23b402-1557-4276-863a-a48a02a075b4)],shared=False,stateful=True,updated_at=2022-09-25T00:57:08Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:08.490380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a437b4ee-1a85-4bcb-a946-c9ab0318509c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (beb36863-8128-4c44-acb6-d9b1d711e507), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:08.491048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a437b4ee-1a85-4bcb-a946-c9ab0318509c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:08Z,description=,direction='ingress',ethertype='IPv4',id=1182087a-45a7-4da4-ba0c-33d813d59c33,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1fba20633c144fe0a8572d2a2343f8c9',protocol=,remote_address_group_id=,remote_group_id=beb36863-8128-4c44-acb6-d9b1d711e507,remote_ip_prefix=,revision_number=0,security_group_id=beb36863-8128-4c44-acb6-d9b1d711e507,updated_at=2022-09-25T00:57:08Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:08.491224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a437b4ee-1a85-4bcb-a946-c9ab0318509c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (1182087a-45a7-4da4-ba0c-33d813d59c33), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:08.491571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a437b4ee-1a85-4bcb-a946-c9ab0318509c admin admin] Security group rule updated ['beb36863-8128-4c44-acb6-d9b1d711e507'] Sep 25 00:57:08.492305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a437b4ee-1a85-4bcb-a946-c9ab0318509c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:08Z,description=,direction='egress',ethertype='IPv6',id=3b5ac9fa-eace-4020-a943-3a9f21f33f88,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1fba20633c144fe0a8572d2a2343f8c9',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=beb36863-8128-4c44-acb6-d9b1d711e507,updated_at=2022-09-25T00:57:08Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:08.492705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a437b4ee-1a85-4bcb-a946-c9ab0318509c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (3b5ac9fa-eace-4020-a943-3a9f21f33f88), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:08.492989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a437b4ee-1a85-4bcb-a946-c9ab0318509c admin admin] Security group rule updated ['beb36863-8128-4c44-acb6-d9b1d711e507'] Sep 25 00:57:08.493676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a437b4ee-1a85-4bcb-a946-c9ab0318509c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:08Z,description=,direction='ingress',ethertype='IPv6',id=5c51a24b-045e-479d-9ce2-afa982faa453,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1fba20633c144fe0a8572d2a2343f8c9',protocol=,remote_address_group_id=,remote_group_id=beb36863-8128-4c44-acb6-d9b1d711e507,remote_ip_prefix=,revision_number=0,security_group_id=beb36863-8128-4c44-acb6-d9b1d711e507,updated_at=2022-09-25T00:57:08Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:08.494030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a437b4ee-1a85-4bcb-a946-c9ab0318509c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (5c51a24b-045e-479d-9ce2-afa982faa453), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:08.494356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a437b4ee-1a85-4bcb-a946-c9ab0318509c admin admin] Security group rule updated ['beb36863-8128-4c44-acb6-d9b1d711e507'] Sep 25 00:57:08.495010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a437b4ee-1a85-4bcb-a946-c9ab0318509c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:08Z,description=,direction='egress',ethertype='IPv4',id=9d23b402-1557-4276-863a-a48a02a075b4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1fba20633c144fe0a8572d2a2343f8c9',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=beb36863-8128-4c44-acb6-d9b1d711e507,updated_at=2022-09-25T00:57:08Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:08.495355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a437b4ee-1a85-4bcb-a946-c9ab0318509c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (9d23b402-1557-4276-863a-a48a02a075b4), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:08.495668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a437b4ee-1a85-4bcb-a946-c9ab0318509c admin admin] Security group rule updated ['beb36863-8128-4c44-acb6-d9b1d711e507'] Sep 25 00:57:08.652768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-29020262-4950-40c3-abf0-73b11aff13f0 admin admin] Resource SecurityGroup deleted: beb36863-8128-4c44-acb6-d9b1d711e507 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:08.653176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-29020262-4950-40c3-abf0-73b11aff13f0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (beb36863-8128-4c44-acb6-d9b1d711e507), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:08.653667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29020262-4950-40c3-abf0-73b11aff13f0 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('beb36863-8128-4c44-acb6-d9b1d711e507',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:57:08.676069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-29020262-4950-40c3-abf0-73b11aff13f0 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('beb36863-8128-4c44-acb6-d9b1d711e507',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:57:08.676630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-29020262-4950-40c3-abf0-73b11aff13f0 admin admin] Resource SecurityGroupRule deleted: 1182087a-45a7-4da4-ba0c-33d813d59c33 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:08.677585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-29020262-4950-40c3-abf0-73b11aff13f0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (1182087a-45a7-4da4-ba0c-33d813d59c33), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:08.677925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-29020262-4950-40c3-abf0-73b11aff13f0 admin admin] Security group rule updated ['beb36863-8128-4c44-acb6-d9b1d711e507'] Sep 25 00:57:08.678476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-29020262-4950-40c3-abf0-73b11aff13f0 admin admin] Resource SecurityGroupRule deleted: 3b5ac9fa-eace-4020-a943-3a9f21f33f88 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:08.678805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-29020262-4950-40c3-abf0-73b11aff13f0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (3b5ac9fa-eace-4020-a943-3a9f21f33f88), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:08.679734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-29020262-4950-40c3-abf0-73b11aff13f0 admin admin] Security group rule updated ['beb36863-8128-4c44-acb6-d9b1d711e507'] Sep 25 00:57:08.682165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-29020262-4950-40c3-abf0-73b11aff13f0 admin admin] Resource SecurityGroupRule deleted: 5c51a24b-045e-479d-9ce2-afa982faa453 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:08.682754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-29020262-4950-40c3-abf0-73b11aff13f0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (5c51a24b-045e-479d-9ce2-afa982faa453), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:08.683593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-29020262-4950-40c3-abf0-73b11aff13f0 admin admin] Security group rule updated ['beb36863-8128-4c44-acb6-d9b1d711e507'] Sep 25 00:57:08.684133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-29020262-4950-40c3-abf0-73b11aff13f0 admin admin] Resource SecurityGroupRule deleted: 9d23b402-1557-4276-863a-a48a02a075b4 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:08.684788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-29020262-4950-40c3-abf0-73b11aff13f0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (9d23b402-1557-4276-863a-a48a02a075b4), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:08.685118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-29020262-4950-40c3-abf0-73b11aff13f0 admin admin] Security group rule updated ['beb36863-8128-4c44-acb6-d9b1d711e507'] Sep 25 00:57:09.253518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b4e6e2b8-4d0a-4c51-a8f1-0d24ef3fb2d8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:57:09Z,description='Default security group',id=83d4ad1b-4a58-4360-9aa3-08187c64b752,is_default=True,name='default',project_id='bec11bdddb3e4993bbbdf5042faa8a60',revision_number=1,rules=[SecurityGroupRule(31ac7c87-901c-4b77-964f-0345d1ee899a),SecurityGroupRule(69c785e7-8e12-43ca-be1d-338927809a15),SecurityGroupRule(6fe266f9-9e16-47c3-b8f6-24dbb2ac009a),SecurityGroupRule(d8729454-3fe0-4c58-992e-1ea78d55f1d8)],shared=False,stateful=True,updated_at=2022-09-25T00:57:09Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:09.255225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b4e6e2b8-4d0a-4c51-a8f1-0d24ef3fb2d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (83d4ad1b-4a58-4360-9aa3-08187c64b752), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:09.257367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b4e6e2b8-4d0a-4c51-a8f1-0d24ef3fb2d8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:09Z,description=,direction='ingress',ethertype='IPv6',id=31ac7c87-901c-4b77-964f-0345d1ee899a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bec11bdddb3e4993bbbdf5042faa8a60',protocol=,remote_address_group_id=,remote_group_id=83d4ad1b-4a58-4360-9aa3-08187c64b752,remote_ip_prefix=,revision_number=0,security_group_id=83d4ad1b-4a58-4360-9aa3-08187c64b752,updated_at=2022-09-25T00:57:09Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:09.258445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b4e6e2b8-4d0a-4c51-a8f1-0d24ef3fb2d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (31ac7c87-901c-4b77-964f-0345d1ee899a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:09.259486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b4e6e2b8-4d0a-4c51-a8f1-0d24ef3fb2d8 admin admin] Security group rule updated ['83d4ad1b-4a58-4360-9aa3-08187c64b752'] Sep 25 00:57:09.261193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b4e6e2b8-4d0a-4c51-a8f1-0d24ef3fb2d8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:09Z,description=,direction='ingress',ethertype='IPv4',id=69c785e7-8e12-43ca-be1d-338927809a15,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bec11bdddb3e4993bbbdf5042faa8a60',protocol=,remote_address_group_id=,remote_group_id=83d4ad1b-4a58-4360-9aa3-08187c64b752,remote_ip_prefix=,revision_number=0,security_group_id=83d4ad1b-4a58-4360-9aa3-08187c64b752,updated_at=2022-09-25T00:57:09Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:09.263233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b4e6e2b8-4d0a-4c51-a8f1-0d24ef3fb2d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (69c785e7-8e12-43ca-be1d-338927809a15), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:09.264128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b4e6e2b8-4d0a-4c51-a8f1-0d24ef3fb2d8 admin admin] Security group rule updated ['83d4ad1b-4a58-4360-9aa3-08187c64b752'] Sep 25 00:57:09.265903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b4e6e2b8-4d0a-4c51-a8f1-0d24ef3fb2d8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:09Z,description=,direction='egress',ethertype='IPv4',id=6fe266f9-9e16-47c3-b8f6-24dbb2ac009a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bec11bdddb3e4993bbbdf5042faa8a60',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=83d4ad1b-4a58-4360-9aa3-08187c64b752,updated_at=2022-09-25T00:57:09Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:09.266289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b4e6e2b8-4d0a-4c51-a8f1-0d24ef3fb2d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (6fe266f9-9e16-47c3-b8f6-24dbb2ac009a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:09.266636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b4e6e2b8-4d0a-4c51-a8f1-0d24ef3fb2d8 admin admin] Security group rule updated ['83d4ad1b-4a58-4360-9aa3-08187c64b752'] Sep 25 00:57:09.268247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b4e6e2b8-4d0a-4c51-a8f1-0d24ef3fb2d8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:09Z,description=,direction='egress',ethertype='IPv6',id=d8729454-3fe0-4c58-992e-1ea78d55f1d8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bec11bdddb3e4993bbbdf5042faa8a60',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=83d4ad1b-4a58-4360-9aa3-08187c64b752,updated_at=2022-09-25T00:57:09Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:09.269660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b4e6e2b8-4d0a-4c51-a8f1-0d24ef3fb2d8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (d8729454-3fe0-4c58-992e-1ea78d55f1d8), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:09.270270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b4e6e2b8-4d0a-4c51-a8f1-0d24ef3fb2d8 admin admin] Security group rule updated ['83d4ad1b-4a58-4360-9aa3-08187c64b752'] Sep 25 00:57:09.530955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4f89b771-52ca-4842-9c8b-1f39db858e53 admin admin] Resource SecurityGroup deleted: 83d4ad1b-4a58-4360-9aa3-08187c64b752 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:09.531818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4f89b771-52ca-4842-9c8b-1f39db858e53 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (83d4ad1b-4a58-4360-9aa3-08187c64b752), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:09.532296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f89b771-52ca-4842-9c8b-1f39db858e53 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('83d4ad1b-4a58-4360-9aa3-08187c64b752',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:57:09.556360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4f89b771-52ca-4842-9c8b-1f39db858e53 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('83d4ad1b-4a58-4360-9aa3-08187c64b752',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:57:09.557477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4f89b771-52ca-4842-9c8b-1f39db858e53 admin admin] Resource SecurityGroupRule deleted: 31ac7c87-901c-4b77-964f-0345d1ee899a {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:09.557929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4f89b771-52ca-4842-9c8b-1f39db858e53 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (31ac7c87-901c-4b77-964f-0345d1ee899a), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:09.558327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-4f89b771-52ca-4842-9c8b-1f39db858e53 admin admin] Security group rule updated ['83d4ad1b-4a58-4360-9aa3-08187c64b752'] Sep 25 00:57:09.558738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4f89b771-52ca-4842-9c8b-1f39db858e53 admin admin] Resource SecurityGroupRule deleted: 69c785e7-8e12-43ca-be1d-338927809a15 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:09.559210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4f89b771-52ca-4842-9c8b-1f39db858e53 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (69c785e7-8e12-43ca-be1d-338927809a15), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:09.559543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-4f89b771-52ca-4842-9c8b-1f39db858e53 admin admin] Security group rule updated ['83d4ad1b-4a58-4360-9aa3-08187c64b752'] Sep 25 00:57:09.559923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4f89b771-52ca-4842-9c8b-1f39db858e53 admin admin] Resource SecurityGroupRule deleted: 6fe266f9-9e16-47c3-b8f6-24dbb2ac009a {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:09.561296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4f89b771-52ca-4842-9c8b-1f39db858e53 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (6fe266f9-9e16-47c3-b8f6-24dbb2ac009a), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:09.561807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-4f89b771-52ca-4842-9c8b-1f39db858e53 admin admin] Security group rule updated ['83d4ad1b-4a58-4360-9aa3-08187c64b752'] Sep 25 00:57:09.562313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4f89b771-52ca-4842-9c8b-1f39db858e53 admin admin] Resource SecurityGroupRule deleted: d8729454-3fe0-4c58-992e-1ea78d55f1d8 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:09.562701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4f89b771-52ca-4842-9c8b-1f39db858e53 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (d8729454-3fe0-4c58-992e-1ea78d55f1d8), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:09.563439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-4f89b771-52ca-4842-9c8b-1f39db858e53 admin admin] Security group rule updated ['83d4ad1b-4a58-4360-9aa3-08187c64b752'] Sep 25 00:57:09.624136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:289 started Sep 25 00:57:09.635644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834defb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=355000000,duration_sec=592,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:09.637455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:57:09.638120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:289 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Sep 25 00:57:10.741892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-50fbc8ac-69b1-424a-8c3d-c8c7a328060b admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:57:10Z,description='Default security group',id=2b6b3eee-9aed-48a1-99dc-1e341378dabc,is_default=True,name='default',project_id='f5780a6d6dde45ae80cd574620660f24',revision_number=1,rules=[SecurityGroupRule(44c83cd7-b8e8-4404-8326-660522614436),SecurityGroupRule(c3812f02-d354-4281-bb83-f8d204ef856a),SecurityGroupRule(d2808e42-2158-49c3-a17d-fdfe8203093e),SecurityGroupRule(d79bc383-7889-42ac-b637-e2eb85375f8d)],shared=False,stateful=True,updated_at=2022-09-25T00:57:10Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:10.742474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-50fbc8ac-69b1-424a-8c3d-c8c7a328060b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (2b6b3eee-9aed-48a1-99dc-1e341378dabc), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:10.742912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-50fbc8ac-69b1-424a-8c3d-c8c7a328060b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:10Z,description=,direction='ingress',ethertype='IPv6',id=44c83cd7-b8e8-4404-8326-660522614436,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f5780a6d6dde45ae80cd574620660f24',protocol=,remote_address_group_id=,remote_group_id=2b6b3eee-9aed-48a1-99dc-1e341378dabc,remote_ip_prefix=,revision_number=0,security_group_id=2b6b3eee-9aed-48a1-99dc-1e341378dabc,updated_at=2022-09-25T00:57:10Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:10.743275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-50fbc8ac-69b1-424a-8c3d-c8c7a328060b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (44c83cd7-b8e8-4404-8326-660522614436), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:10.743614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-50fbc8ac-69b1-424a-8c3d-c8c7a328060b admin admin] Security group rule updated ['2b6b3eee-9aed-48a1-99dc-1e341378dabc'] Sep 25 00:57:10.744291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-50fbc8ac-69b1-424a-8c3d-c8c7a328060b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:10Z,description=,direction='egress',ethertype='IPv6',id=c3812f02-d354-4281-bb83-f8d204ef856a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f5780a6d6dde45ae80cd574620660f24',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2b6b3eee-9aed-48a1-99dc-1e341378dabc,updated_at=2022-09-25T00:57:10Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:10.744652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-50fbc8ac-69b1-424a-8c3d-c8c7a328060b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (c3812f02-d354-4281-bb83-f8d204ef856a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:10.744980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-50fbc8ac-69b1-424a-8c3d-c8c7a328060b admin admin] Security group rule updated ['2b6b3eee-9aed-48a1-99dc-1e341378dabc'] Sep 25 00:57:10.746014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-50fbc8ac-69b1-424a-8c3d-c8c7a328060b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:10Z,description=,direction='ingress',ethertype='IPv4',id=d2808e42-2158-49c3-a17d-fdfe8203093e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f5780a6d6dde45ae80cd574620660f24',protocol=,remote_address_group_id=,remote_group_id=2b6b3eee-9aed-48a1-99dc-1e341378dabc,remote_ip_prefix=,revision_number=0,security_group_id=2b6b3eee-9aed-48a1-99dc-1e341378dabc,updated_at=2022-09-25T00:57:10Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:10.746358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-50fbc8ac-69b1-424a-8c3d-c8c7a328060b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (d2808e42-2158-49c3-a17d-fdfe8203093e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:10.746676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-50fbc8ac-69b1-424a-8c3d-c8c7a328060b admin admin] Security group rule updated ['2b6b3eee-9aed-48a1-99dc-1e341378dabc'] Sep 25 00:57:10.747530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-50fbc8ac-69b1-424a-8c3d-c8c7a328060b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:10Z,description=,direction='egress',ethertype='IPv4',id=d79bc383-7889-42ac-b637-e2eb85375f8d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f5780a6d6dde45ae80cd574620660f24',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2b6b3eee-9aed-48a1-99dc-1e341378dabc,updated_at=2022-09-25T00:57:10Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:10.747891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-50fbc8ac-69b1-424a-8c3d-c8c7a328060b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (d79bc383-7889-42ac-b637-e2eb85375f8d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:10.748218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-50fbc8ac-69b1-424a-8c3d-c8c7a328060b admin admin] Security group rule updated ['2b6b3eee-9aed-48a1-99dc-1e341378dabc'] Sep 25 00:57:10.894745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e77846d7-490c-4f20-94ca-0aac5cc201ce admin admin] Resource SecurityGroup deleted: 2b6b3eee-9aed-48a1-99dc-1e341378dabc {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:10.895176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e77846d7-490c-4f20-94ca-0aac5cc201ce admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (2b6b3eee-9aed-48a1-99dc-1e341378dabc), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:10.896177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e77846d7-490c-4f20-94ca-0aac5cc201ce admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2b6b3eee-9aed-48a1-99dc-1e341378dabc',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:57:10.915067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e77846d7-490c-4f20-94ca-0aac5cc201ce admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2b6b3eee-9aed-48a1-99dc-1e341378dabc',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:57:10.915455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e77846d7-490c-4f20-94ca-0aac5cc201ce admin admin] Resource SecurityGroupRule deleted: 44c83cd7-b8e8-4404-8326-660522614436 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:10.915830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e77846d7-490c-4f20-94ca-0aac5cc201ce admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (44c83cd7-b8e8-4404-8326-660522614436), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:10.916166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-e77846d7-490c-4f20-94ca-0aac5cc201ce admin admin] Security group rule updated ['2b6b3eee-9aed-48a1-99dc-1e341378dabc'] Sep 25 00:57:10.916734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e77846d7-490c-4f20-94ca-0aac5cc201ce admin admin] Resource SecurityGroupRule deleted: c3812f02-d354-4281-bb83-f8d204ef856a {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:10.917084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e77846d7-490c-4f20-94ca-0aac5cc201ce admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (c3812f02-d354-4281-bb83-f8d204ef856a), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:10.917441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-e77846d7-490c-4f20-94ca-0aac5cc201ce admin admin] Security group rule updated ['2b6b3eee-9aed-48a1-99dc-1e341378dabc'] Sep 25 00:57:10.918251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e77846d7-490c-4f20-94ca-0aac5cc201ce admin admin] Resource SecurityGroupRule deleted: d2808e42-2158-49c3-a17d-fdfe8203093e {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:10.918588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e77846d7-490c-4f20-94ca-0aac5cc201ce admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (d2808e42-2158-49c3-a17d-fdfe8203093e), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:10.918921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-e77846d7-490c-4f20-94ca-0aac5cc201ce admin admin] Security group rule updated ['2b6b3eee-9aed-48a1-99dc-1e341378dabc'] Sep 25 00:57:10.919568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e77846d7-490c-4f20-94ca-0aac5cc201ce admin admin] Resource SecurityGroupRule deleted: d79bc383-7889-42ac-b637-e2eb85375f8d {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:10.919920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e77846d7-490c-4f20-94ca-0aac5cc201ce admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (d79bc383-7889-42ac-b637-e2eb85375f8d), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:10.920243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-e77846d7-490c-4f20-94ca-0aac5cc201ce admin admin] Security group rule updated ['2b6b3eee-9aed-48a1-99dc-1e341378dabc'] Sep 25 00:57:11.501511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ab9541b1-fa5f-41bf-bc59-e22f9e60b933 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:57:11Z,description='Default security group',id=c245bfc7-5a9d-462e-9ec0-1d6fd26d84e9,is_default=True,name='default',project_id='9802a2faa6b749f9b4850348c95f8ea3',revision_number=1,rules=[SecurityGroupRule(388c94dd-a9b0-4a85-8b94-6d30a90d4181),SecurityGroupRule(7673d54e-3820-42b5-bfb2-81fcd3b3eae6),SecurityGroupRule(acdefb82-fa9b-4a0d-a5b7-4e672f246538),SecurityGroupRule(d908a7d7-cdf0-452c-a2f3-866ad8683f96)],shared=False,stateful=True,updated_at=2022-09-25T00:57:11Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:11.501905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ab9541b1-fa5f-41bf-bc59-e22f9e60b933 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (c245bfc7-5a9d-462e-9ec0-1d6fd26d84e9), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:11.505372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ab9541b1-fa5f-41bf-bc59-e22f9e60b933 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:11Z,description=,direction='egress',ethertype='IPv4',id=388c94dd-a9b0-4a85-8b94-6d30a90d4181,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9802a2faa6b749f9b4850348c95f8ea3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c245bfc7-5a9d-462e-9ec0-1d6fd26d84e9,updated_at=2022-09-25T00:57:11Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:11.507828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ab9541b1-fa5f-41bf-bc59-e22f9e60b933 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (388c94dd-a9b0-4a85-8b94-6d30a90d4181), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:11.508187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ab9541b1-fa5f-41bf-bc59-e22f9e60b933 admin admin] Security group rule updated ['c245bfc7-5a9d-462e-9ec0-1d6fd26d84e9'] Sep 25 00:57:11.508925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ab9541b1-fa5f-41bf-bc59-e22f9e60b933 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:11Z,description=,direction='ingress',ethertype='IPv4',id=7673d54e-3820-42b5-bfb2-81fcd3b3eae6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9802a2faa6b749f9b4850348c95f8ea3',protocol=,remote_address_group_id=,remote_group_id=c245bfc7-5a9d-462e-9ec0-1d6fd26d84e9,remote_ip_prefix=,revision_number=0,security_group_id=c245bfc7-5a9d-462e-9ec0-1d6fd26d84e9,updated_at=2022-09-25T00:57:11Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:11.509338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ab9541b1-fa5f-41bf-bc59-e22f9e60b933 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (7673d54e-3820-42b5-bfb2-81fcd3b3eae6), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:11.509654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ab9541b1-fa5f-41bf-bc59-e22f9e60b933 admin admin] Security group rule updated ['c245bfc7-5a9d-462e-9ec0-1d6fd26d84e9'] Sep 25 00:57:11.510333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ab9541b1-fa5f-41bf-bc59-e22f9e60b933 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:11Z,description=,direction='ingress',ethertype='IPv6',id=acdefb82-fa9b-4a0d-a5b7-4e672f246538,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9802a2faa6b749f9b4850348c95f8ea3',protocol=,remote_address_group_id=,remote_group_id=c245bfc7-5a9d-462e-9ec0-1d6fd26d84e9,remote_ip_prefix=,revision_number=0,security_group_id=c245bfc7-5a9d-462e-9ec0-1d6fd26d84e9,updated_at=2022-09-25T00:57:11Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:11.510694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ab9541b1-fa5f-41bf-bc59-e22f9e60b933 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (acdefb82-fa9b-4a0d-a5b7-4e672f246538), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:11.517550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ab9541b1-fa5f-41bf-bc59-e22f9e60b933 admin admin] Security group rule updated ['c245bfc7-5a9d-462e-9ec0-1d6fd26d84e9'] Sep 25 00:57:11.519065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ab9541b1-fa5f-41bf-bc59-e22f9e60b933 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:11Z,description=,direction='egress',ethertype='IPv6',id=d908a7d7-cdf0-452c-a2f3-866ad8683f96,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9802a2faa6b749f9b4850348c95f8ea3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c245bfc7-5a9d-462e-9ec0-1d6fd26d84e9,updated_at=2022-09-25T00:57:11Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:11.519454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ab9541b1-fa5f-41bf-bc59-e22f9e60b933 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (d908a7d7-cdf0-452c-a2f3-866ad8683f96), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:11.519797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ab9541b1-fa5f-41bf-bc59-e22f9e60b933 admin admin] Security group rule updated ['c245bfc7-5a9d-462e-9ec0-1d6fd26d84e9'] Sep 25 00:57:11.625697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:290 started Sep 25 00:57:11.629833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834defd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=354000000,duration_sec=594,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:11.631605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:57:11.637157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:290 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 25 00:57:11.663371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2c512bf6-022b-465b-ad1c-caf3d405a217 admin admin] Resource SecurityGroup deleted: c245bfc7-5a9d-462e-9ec0-1d6fd26d84e9 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:11.663840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2c512bf6-022b-465b-ad1c-caf3d405a217 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (c245bfc7-5a9d-462e-9ec0-1d6fd26d84e9), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:11.664363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c512bf6-022b-465b-ad1c-caf3d405a217 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c245bfc7-5a9d-462e-9ec0-1d6fd26d84e9',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:57:11.678457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2c512bf6-022b-465b-ad1c-caf3d405a217 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c245bfc7-5a9d-462e-9ec0-1d6fd26d84e9',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:57:11.679336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2c512bf6-022b-465b-ad1c-caf3d405a217 admin admin] Resource SecurityGroupRule deleted: 388c94dd-a9b0-4a85-8b94-6d30a90d4181 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:11.679971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2c512bf6-022b-465b-ad1c-caf3d405a217 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (388c94dd-a9b0-4a85-8b94-6d30a90d4181), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:11.680407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2c512bf6-022b-465b-ad1c-caf3d405a217 admin admin] Security group rule updated ['c245bfc7-5a9d-462e-9ec0-1d6fd26d84e9'] Sep 25 00:57:11.681172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2c512bf6-022b-465b-ad1c-caf3d405a217 admin admin] Resource SecurityGroupRule deleted: 7673d54e-3820-42b5-bfb2-81fcd3b3eae6 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:11.681616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2c512bf6-022b-465b-ad1c-caf3d405a217 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (7673d54e-3820-42b5-bfb2-81fcd3b3eae6), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:11.683187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2c512bf6-022b-465b-ad1c-caf3d405a217 admin admin] Security group rule updated ['c245bfc7-5a9d-462e-9ec0-1d6fd26d84e9'] Sep 25 00:57:11.683710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2c512bf6-022b-465b-ad1c-caf3d405a217 admin admin] Resource SecurityGroupRule deleted: acdefb82-fa9b-4a0d-a5b7-4e672f246538 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:11.684121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2c512bf6-022b-465b-ad1c-caf3d405a217 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (acdefb82-fa9b-4a0d-a5b7-4e672f246538), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:11.684506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2c512bf6-022b-465b-ad1c-caf3d405a217 admin admin] Security group rule updated ['c245bfc7-5a9d-462e-9ec0-1d6fd26d84e9'] Sep 25 00:57:11.684996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2c512bf6-022b-465b-ad1c-caf3d405a217 admin admin] Resource SecurityGroupRule deleted: d908a7d7-cdf0-452c-a2f3-866ad8683f96 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:11.685396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2c512bf6-022b-465b-ad1c-caf3d405a217 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (d908a7d7-cdf0-452c-a2f3-866ad8683f96), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:11.685801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2c512bf6-022b-465b-ad1c-caf3d405a217 admin admin] Security group rule updated ['c245bfc7-5a9d-462e-9ec0-1d6fd26d84e9'] Sep 25 00:57:13.118522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0666f30b-1f05-4573-ab34-980ff4ba8683 admin admin] Resource Subnet deleted: 628d6164-8561-43a3-90c1-471d3db273ff {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:13.120279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0666f30b-1f05-4573-ab34-980ff4ba8683 admin admin] Publish callbacks [] for Subnet (628d6164-8561-43a3-90c1-471d3db273ff), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:13.625991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:291 started Sep 25 00:57:13.628320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834deff,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=354000000,duration_sec=596,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:13.628900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:57:13.629274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:291 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:57:14.046613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fecc0215-a42b-4483-8363-994244986b7b admin admin] Resource Network deleted: 98bf713b-ce3d-430d-9b8a-f3f243e74a76 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:14.047427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fecc0215-a42b-4483-8363-994244986b7b admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (98bf713b-ce3d-430d-9b8a-f3f243e74a76), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:14.229794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ff0fce27-bff9-4cb1-af5c-7d90f852be4e tempest-DeleteServersTestJSON-1998596361 tempest-DeleteServersTestJSON-1998596361-project] Resource Port deleted: 9618d105-fdf7-4a07-9a29-e94ba03b6c41 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:14.231730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ff0fce27-bff9-4cb1-af5c-7d90f852be4e tempest-DeleteServersTestJSON-1998596361 tempest-DeleteServersTestJSON-1998596361-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (9618d105-fdf7-4a07-9a29-e94ba03b6c41), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:14.232826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ff0fce27-bff9-4cb1-af5c-7d90f852be4e tempest-DeleteServersTestJSON-1998596361 tempest-DeleteServersTestJSON-1998596361-project] Security group member updated {'33e8b406-0d9d-4791-be58-7ab180367bdc'} Sep 25 00:57:14.471875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a22022aa-6e1e-48ce-974b-1922a3a806ac admin admin] Resource Subnet deleted: b62565db-c94b-4d28-ad3c-a8a5b6d7602f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:14.472762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a22022aa-6e1e-48ce-974b-1922a3a806ac admin admin] Publish callbacks [] for Subnet (b62565db-c94b-4d28-ad3c-a8a5b6d7602f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:15.014588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3bcd83d0-5495-4802-a187-c6068a863976 admin admin] Resource Network deleted: 1435cc3d-9242-4a80-9d0b-c2f0cf952a66 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:15.014970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3bcd83d0-5495-4802-a187-c6068a863976 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (1435cc3d-9242-4a80-9d0b-c2f0cf952a66), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:15.402579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-95b1102a-f312-42b2-a62b-c6a3f5ed6924 admin admin] Resource SecurityGroup deleted: 7ad4e2ea-12a4-4242-baae-4ae67e21523f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:15.403191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-95b1102a-f312-42b2-a62b-c6a3f5ed6924 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (7ad4e2ea-12a4-4242-baae-4ae67e21523f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:15.403412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95b1102a-f312-42b2-a62b-c6a3f5ed6924 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('7ad4e2ea-12a4-4242-baae-4ae67e21523f',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:57:15.418882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-95b1102a-f312-42b2-a62b-c6a3f5ed6924 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('7ad4e2ea-12a4-4242-baae-4ae67e21523f',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:57:15.419622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-95b1102a-f312-42b2-a62b-c6a3f5ed6924 admin admin] Resource SecurityGroupRule deleted: 5a7923fc-5936-40e8-8879-846315808fe4 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:15.420154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-95b1102a-f312-42b2-a62b-c6a3f5ed6924 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (5a7923fc-5936-40e8-8879-846315808fe4), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:15.420715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-95b1102a-f312-42b2-a62b-c6a3f5ed6924 admin admin] Security group rule updated ['7ad4e2ea-12a4-4242-baae-4ae67e21523f'] Sep 25 00:57:15.421565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-95b1102a-f312-42b2-a62b-c6a3f5ed6924 admin admin] Resource SecurityGroupRule deleted: 6ba3f91e-7f00-40dd-b54a-44def3cd3fc1 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:15.422237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-95b1102a-f312-42b2-a62b-c6a3f5ed6924 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (6ba3f91e-7f00-40dd-b54a-44def3cd3fc1), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:15.422829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-95b1102a-f312-42b2-a62b-c6a3f5ed6924 admin admin] Security group rule updated ['7ad4e2ea-12a4-4242-baae-4ae67e21523f'] Sep 25 00:57:15.423362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-95b1102a-f312-42b2-a62b-c6a3f5ed6924 admin admin] Resource SecurityGroupRule deleted: 89928127-39b6-4e63-89bb-f6309321de94 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:15.424171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-95b1102a-f312-42b2-a62b-c6a3f5ed6924 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (89928127-39b6-4e63-89bb-f6309321de94), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:15.424864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-95b1102a-f312-42b2-a62b-c6a3f5ed6924 admin admin] Security group rule updated ['7ad4e2ea-12a4-4242-baae-4ae67e21523f'] Sep 25 00:57:15.425416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-95b1102a-f312-42b2-a62b-c6a3f5ed6924 admin admin] Resource SecurityGroupRule deleted: a7942531-42ad-437a-a522-587e0bdfb73c {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:15.426250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-95b1102a-f312-42b2-a62b-c6a3f5ed6924 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (a7942531-42ad-437a-a522-587e0bdfb73c), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:15.427376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-95b1102a-f312-42b2-a62b-c6a3f5ed6924 admin admin] Security group rule updated ['7ad4e2ea-12a4-4242-baae-4ae67e21523f'] Sep 25 00:57:15.626584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:292 started Sep 25 00:57:15.631418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df01,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=356000000,duration_sec=598,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:15.633112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:57:15.633876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:292 - starting polling. Elapsed:0.007 Sep 25 00:57:15.636660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:15.638825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 9618d105-fdf7-4a07-9a29-e94ba03b6c41 not present in bridge br-int Sep 25 00:57:15.639526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 00:57:15.639885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['9618d105-fdf7-4a07-9a29-e94ba03b6c41'] Sep 25 00:57:15.640291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 9618d105-fdf7-4a07-9a29-e94ba03b6c41 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 00:57:15.653075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:292 - port information retrieved. Elapsed:0.018 Sep 25 00:57:15.653075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:292 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.019 Sep 25 00:57:16.011131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fd9b0ce5-1774-436b-9d7e-a8ea14ad1599 admin admin] Resource SecurityGroup deleted: 1c03f997-b07a-43e3-8f13-07bed615aa08 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:16.011594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fd9b0ce5-1774-436b-9d7e-a8ea14ad1599 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (1c03f997-b07a-43e3-8f13-07bed615aa08), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:16.012335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd9b0ce5-1774-436b-9d7e-a8ea14ad1599 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('1c03f997-b07a-43e3-8f13-07bed615aa08',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:57:16.031845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fd9b0ce5-1774-436b-9d7e-a8ea14ad1599 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('1c03f997-b07a-43e3-8f13-07bed615aa08',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:57:16.032320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fd9b0ce5-1774-436b-9d7e-a8ea14ad1599 admin admin] Resource SecurityGroupRule deleted: 336b4bdd-0c3f-48c0-8474-7d9e86105da1 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:16.032696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fd9b0ce5-1774-436b-9d7e-a8ea14ad1599 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (336b4bdd-0c3f-48c0-8474-7d9e86105da1), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:16.033044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-fd9b0ce5-1774-436b-9d7e-a8ea14ad1599 admin admin] Security group rule updated ['1c03f997-b07a-43e3-8f13-07bed615aa08'] Sep 25 00:57:16.038128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fd9b0ce5-1774-436b-9d7e-a8ea14ad1599 admin admin] Resource SecurityGroupRule deleted: 7a11bc8e-52b5-4f46-b37b-72ab8146ac6f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:16.038579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fd9b0ce5-1774-436b-9d7e-a8ea14ad1599 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (7a11bc8e-52b5-4f46-b37b-72ab8146ac6f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:16.039105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-fd9b0ce5-1774-436b-9d7e-a8ea14ad1599 admin admin] Security group rule updated ['1c03f997-b07a-43e3-8f13-07bed615aa08'] Sep 25 00:57:16.039521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fd9b0ce5-1774-436b-9d7e-a8ea14ad1599 admin admin] Resource SecurityGroupRule deleted: be787dc3-0328-4d62-ab38-991b9a153870 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:16.039875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fd9b0ce5-1774-436b-9d7e-a8ea14ad1599 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (be787dc3-0328-4d62-ab38-991b9a153870), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:16.040204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-fd9b0ce5-1774-436b-9d7e-a8ea14ad1599 admin admin] Security group rule updated ['1c03f997-b07a-43e3-8f13-07bed615aa08'] Sep 25 00:57:16.040583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fd9b0ce5-1774-436b-9d7e-a8ea14ad1599 admin admin] Resource SecurityGroupRule deleted: fed61ac1-1f05-4467-adf0-80c72e9faf80 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:16.040936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fd9b0ce5-1774-436b-9d7e-a8ea14ad1599 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (fed61ac1-1f05-4467-adf0-80c72e9faf80), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:16.041771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-fd9b0ce5-1774-436b-9d7e-a8ea14ad1599 admin admin] Security group rule updated ['1c03f997-b07a-43e3-8f13-07bed615aa08'] Sep 25 00:57:17.627953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:293 started Sep 25 00:57:17.631509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df03,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=356000000,duration_sec=600,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:17.632110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:57:17.632467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:293 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:57:19.629028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:294 started Sep 25 00:57:19.634996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df05,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=361000000,duration_sec=602,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:19.635563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:57:19.635918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:294 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 00:57:21.630666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:295 started Sep 25 00:57:21.633106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df07,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=359000000,duration_sec=604,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:21.633758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:57:21.634114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:295 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:57:23.631636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:296 started Sep 25 00:57:23.634482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df09,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=360000000,duration_sec=606,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:23.635049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:57:23.635410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:296 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:57:25.058026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b6584ac6-99bb-4897-85eb-8aa7054d2a74 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:57:24Z,description='Default security group',id=f00e53a8-61d0-4d60-9c5a-991933522316,is_default=True,name='default',project_id='7bc12e750566459ebac4a268b257f1c7',revision_number=1,rules=[SecurityGroupRule(011baefb-2049-4aba-82f0-89472af3cc86),SecurityGroupRule(9cf4df1c-a78f-4b4e-a15b-0a2626c74e00),SecurityGroupRule(cbcf8459-7846-4360-8c02-4d3a78305bc1),SecurityGroupRule(d1bd8326-d4a4-48c3-a407-6d5bcb2c62a2)],shared=False,stateful=True,updated_at=2022-09-25T00:57:24Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:25.059212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b6584ac6-99bb-4897-85eb-8aa7054d2a74 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (f00e53a8-61d0-4d60-9c5a-991933522316), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:25.059927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b6584ac6-99bb-4897-85eb-8aa7054d2a74 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:24Z,description=,direction='egress',ethertype='IPv6',id=011baefb-2049-4aba-82f0-89472af3cc86,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7bc12e750566459ebac4a268b257f1c7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f00e53a8-61d0-4d60-9c5a-991933522316,updated_at=2022-09-25T00:57:24Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:25.060362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b6584ac6-99bb-4897-85eb-8aa7054d2a74 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (011baefb-2049-4aba-82f0-89472af3cc86), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:25.060776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b6584ac6-99bb-4897-85eb-8aa7054d2a74 admin admin] Security group rule updated ['f00e53a8-61d0-4d60-9c5a-991933522316'] Sep 25 00:57:25.061556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b6584ac6-99bb-4897-85eb-8aa7054d2a74 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:24Z,description=,direction='egress',ethertype='IPv4',id=9cf4df1c-a78f-4b4e-a15b-0a2626c74e00,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7bc12e750566459ebac4a268b257f1c7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f00e53a8-61d0-4d60-9c5a-991933522316,updated_at=2022-09-25T00:57:24Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:25.061985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b6584ac6-99bb-4897-85eb-8aa7054d2a74 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (9cf4df1c-a78f-4b4e-a15b-0a2626c74e00), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:25.062398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b6584ac6-99bb-4897-85eb-8aa7054d2a74 admin admin] Security group rule updated ['f00e53a8-61d0-4d60-9c5a-991933522316'] Sep 25 00:57:25.063163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b6584ac6-99bb-4897-85eb-8aa7054d2a74 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:24Z,description=,direction='ingress',ethertype='IPv6',id=cbcf8459-7846-4360-8c02-4d3a78305bc1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7bc12e750566459ebac4a268b257f1c7',protocol=,remote_address_group_id=,remote_group_id=f00e53a8-61d0-4d60-9c5a-991933522316,remote_ip_prefix=,revision_number=0,security_group_id=f00e53a8-61d0-4d60-9c5a-991933522316,updated_at=2022-09-25T00:57:24Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:25.063679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b6584ac6-99bb-4897-85eb-8aa7054d2a74 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (cbcf8459-7846-4360-8c02-4d3a78305bc1), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:25.064467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b6584ac6-99bb-4897-85eb-8aa7054d2a74 admin admin] Security group rule updated ['f00e53a8-61d0-4d60-9c5a-991933522316'] Sep 25 00:57:25.065145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b6584ac6-99bb-4897-85eb-8aa7054d2a74 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:24Z,description=,direction='ingress',ethertype='IPv4',id=d1bd8326-d4a4-48c3-a407-6d5bcb2c62a2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7bc12e750566459ebac4a268b257f1c7',protocol=,remote_address_group_id=,remote_group_id=f00e53a8-61d0-4d60-9c5a-991933522316,remote_ip_prefix=,revision_number=0,security_group_id=f00e53a8-61d0-4d60-9c5a-991933522316,updated_at=2022-09-25T00:57:24Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:25.065530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b6584ac6-99bb-4897-85eb-8aa7054d2a74 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (d1bd8326-d4a4-48c3-a407-6d5bcb2c62a2), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:25.065860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b6584ac6-99bb-4897-85eb-8aa7054d2a74 admin admin] Security group rule updated ['f00e53a8-61d0-4d60-9c5a-991933522316'] Sep 25 00:57:25.325387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9c0c7fa2-e3e1-4891-bed6-17d1c407dce9 admin admin] Resource SecurityGroup deleted: f00e53a8-61d0-4d60-9c5a-991933522316 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:25.326166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9c0c7fa2-e3e1-4891-bed6-17d1c407dce9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (f00e53a8-61d0-4d60-9c5a-991933522316), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:25.326783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c0c7fa2-e3e1-4891-bed6-17d1c407dce9 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('f00e53a8-61d0-4d60-9c5a-991933522316',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:57:25.347705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9c0c7fa2-e3e1-4891-bed6-17d1c407dce9 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('f00e53a8-61d0-4d60-9c5a-991933522316',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:57:25.348749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9c0c7fa2-e3e1-4891-bed6-17d1c407dce9 admin admin] Resource SecurityGroupRule deleted: 011baefb-2049-4aba-82f0-89472af3cc86 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:25.349677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9c0c7fa2-e3e1-4891-bed6-17d1c407dce9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (011baefb-2049-4aba-82f0-89472af3cc86), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:25.350011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9c0c7fa2-e3e1-4891-bed6-17d1c407dce9 admin admin] Security group rule updated ['f00e53a8-61d0-4d60-9c5a-991933522316'] Sep 25 00:57:25.350758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9c0c7fa2-e3e1-4891-bed6-17d1c407dce9 admin admin] Resource SecurityGroupRule deleted: 9cf4df1c-a78f-4b4e-a15b-0a2626c74e00 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:25.351116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9c0c7fa2-e3e1-4891-bed6-17d1c407dce9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (9cf4df1c-a78f-4b4e-a15b-0a2626c74e00), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:25.351438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9c0c7fa2-e3e1-4891-bed6-17d1c407dce9 admin admin] Security group rule updated ['f00e53a8-61d0-4d60-9c5a-991933522316'] Sep 25 00:57:25.351819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9c0c7fa2-e3e1-4891-bed6-17d1c407dce9 admin admin] Resource SecurityGroupRule deleted: cbcf8459-7846-4360-8c02-4d3a78305bc1 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:25.352161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9c0c7fa2-e3e1-4891-bed6-17d1c407dce9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (cbcf8459-7846-4360-8c02-4d3a78305bc1), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:25.352474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9c0c7fa2-e3e1-4891-bed6-17d1c407dce9 admin admin] Security group rule updated ['f00e53a8-61d0-4d60-9c5a-991933522316'] Sep 25 00:57:25.352843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9c0c7fa2-e3e1-4891-bed6-17d1c407dce9 admin admin] Resource SecurityGroupRule deleted: d1bd8326-d4a4-48c3-a407-6d5bcb2c62a2 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:25.353186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9c0c7fa2-e3e1-4891-bed6-17d1c407dce9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (d1bd8326-d4a4-48c3-a407-6d5bcb2c62a2), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:25.353525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9c0c7fa2-e3e1-4891-bed6-17d1c407dce9 admin admin] Security group rule updated ['f00e53a8-61d0-4d60-9c5a-991933522316'] Sep 25 00:57:25.632459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:297 started Sep 25 00:57:25.635788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df0b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=361000000,duration_sec=608,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:25.636908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:57:25.637474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:297 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:57:25.882042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5c76293c-f64a-4114-abfc-a86d6bd2c485 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:57:25Z,description='Default security group',id=6c3a2a03-88cd-40f3-acce-b7c2174a93cd,is_default=True,name='default',project_id='27ee0e177ad6403eaa8602e1e0416ddf',revision_number=1,rules=[SecurityGroupRule(058dc8cb-c859-45f6-8c61-b70dbd1d355f),SecurityGroupRule(1106b44a-5ad4-456d-9251-d48d5a4a9794),SecurityGroupRule(355b2dd8-32d2-421a-ab84-7a40a8df0f0e),SecurityGroupRule(e5b4827f-321c-456c-9776-dabf0e2234b6)],shared=False,stateful=True,updated_at=2022-09-25T00:57:25Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:25.882504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5c76293c-f64a-4114-abfc-a86d6bd2c485 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (6c3a2a03-88cd-40f3-acce-b7c2174a93cd), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:25.883299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5c76293c-f64a-4114-abfc-a86d6bd2c485 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:25Z,description=,direction='ingress',ethertype='IPv6',id=058dc8cb-c859-45f6-8c61-b70dbd1d355f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='27ee0e177ad6403eaa8602e1e0416ddf',protocol=,remote_address_group_id=,remote_group_id=6c3a2a03-88cd-40f3-acce-b7c2174a93cd,remote_ip_prefix=,revision_number=0,security_group_id=6c3a2a03-88cd-40f3-acce-b7c2174a93cd,updated_at=2022-09-25T00:57:25Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:25.883682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5c76293c-f64a-4114-abfc-a86d6bd2c485 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (058dc8cb-c859-45f6-8c61-b70dbd1d355f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:25.884013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5c76293c-f64a-4114-abfc-a86d6bd2c485 admin admin] Security group rule updated ['6c3a2a03-88cd-40f3-acce-b7c2174a93cd'] Sep 25 00:57:25.884897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5c76293c-f64a-4114-abfc-a86d6bd2c485 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:25Z,description=,direction='egress',ethertype='IPv6',id=1106b44a-5ad4-456d-9251-d48d5a4a9794,normalized_cidr=None,port_range_max=,port_range_min=,project_id='27ee0e177ad6403eaa8602e1e0416ddf',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6c3a2a03-88cd-40f3-acce-b7c2174a93cd,updated_at=2022-09-25T00:57:25Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:25.885337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5c76293c-f64a-4114-abfc-a86d6bd2c485 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (1106b44a-5ad4-456d-9251-d48d5a4a9794), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:25.885680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5c76293c-f64a-4114-abfc-a86d6bd2c485 admin admin] Security group rule updated ['6c3a2a03-88cd-40f3-acce-b7c2174a93cd'] Sep 25 00:57:25.886697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5c76293c-f64a-4114-abfc-a86d6bd2c485 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:25Z,description=,direction='ingress',ethertype='IPv4',id=355b2dd8-32d2-421a-ab84-7a40a8df0f0e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='27ee0e177ad6403eaa8602e1e0416ddf',protocol=,remote_address_group_id=,remote_group_id=6c3a2a03-88cd-40f3-acce-b7c2174a93cd,remote_ip_prefix=,revision_number=0,security_group_id=6c3a2a03-88cd-40f3-acce-b7c2174a93cd,updated_at=2022-09-25T00:57:25Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:25.889043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5c76293c-f64a-4114-abfc-a86d6bd2c485 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (355b2dd8-32d2-421a-ab84-7a40a8df0f0e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:25.889893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5c76293c-f64a-4114-abfc-a86d6bd2c485 admin admin] Security group rule updated ['6c3a2a03-88cd-40f3-acce-b7c2174a93cd'] Sep 25 00:57:25.890750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5c76293c-f64a-4114-abfc-a86d6bd2c485 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:25Z,description=,direction='egress',ethertype='IPv4',id=e5b4827f-321c-456c-9776-dabf0e2234b6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='27ee0e177ad6403eaa8602e1e0416ddf',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6c3a2a03-88cd-40f3-acce-b7c2174a93cd,updated_at=2022-09-25T00:57:25Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:25.891933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5c76293c-f64a-4114-abfc-a86d6bd2c485 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (e5b4827f-321c-456c-9776-dabf0e2234b6), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:25.892445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5c76293c-f64a-4114-abfc-a86d6bd2c485 admin admin] Security group rule updated ['6c3a2a03-88cd-40f3-acce-b7c2174a93cd'] Sep 25 00:57:25.916320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4ca10207-d390-4cc0-9fb9-8774f3a92336 admin admin] Resource Port deleted: a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:25.916783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4ca10207-d390-4cc0-9fb9-8774f3a92336 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:26.087250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f48d8dc3-343a-4f9b-9162-ddfa02cf3ad8 admin admin] Resource SecurityGroup deleted: 6c3a2a03-88cd-40f3-acce-b7c2174a93cd {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:26.087836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f48d8dc3-343a-4f9b-9162-ddfa02cf3ad8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (6c3a2a03-88cd-40f3-acce-b7c2174a93cd), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:26.088064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f48d8dc3-343a-4f9b-9162-ddfa02cf3ad8 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('6c3a2a03-88cd-40f3-acce-b7c2174a93cd',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:57:26.102456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f48d8dc3-343a-4f9b-9162-ddfa02cf3ad8 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('6c3a2a03-88cd-40f3-acce-b7c2174a93cd',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:57:26.103175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f48d8dc3-343a-4f9b-9162-ddfa02cf3ad8 admin admin] Resource SecurityGroupRule deleted: 058dc8cb-c859-45f6-8c61-b70dbd1d355f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:26.103731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f48d8dc3-343a-4f9b-9162-ddfa02cf3ad8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (058dc8cb-c859-45f6-8c61-b70dbd1d355f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:26.104224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f48d8dc3-343a-4f9b-9162-ddfa02cf3ad8 admin admin] Security group rule updated ['6c3a2a03-88cd-40f3-acce-b7c2174a93cd'] Sep 25 00:57:26.104774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f48d8dc3-343a-4f9b-9162-ddfa02cf3ad8 admin admin] Resource SecurityGroupRule deleted: 1106b44a-5ad4-456d-9251-d48d5a4a9794 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:26.105300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f48d8dc3-343a-4f9b-9162-ddfa02cf3ad8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (1106b44a-5ad4-456d-9251-d48d5a4a9794), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:26.106069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f48d8dc3-343a-4f9b-9162-ddfa02cf3ad8 admin admin] Security group rule updated ['6c3a2a03-88cd-40f3-acce-b7c2174a93cd'] Sep 25 00:57:26.106677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f48d8dc3-343a-4f9b-9162-ddfa02cf3ad8 admin admin] Resource SecurityGroupRule deleted: 355b2dd8-32d2-421a-ab84-7a40a8df0f0e {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:26.107588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f48d8dc3-343a-4f9b-9162-ddfa02cf3ad8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (355b2dd8-32d2-421a-ab84-7a40a8df0f0e), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:26.108143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f48d8dc3-343a-4f9b-9162-ddfa02cf3ad8 admin admin] Security group rule updated ['6c3a2a03-88cd-40f3-acce-b7c2174a93cd'] Sep 25 00:57:26.108708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f48d8dc3-343a-4f9b-9162-ddfa02cf3ad8 admin admin] Resource SecurityGroupRule deleted: e5b4827f-321c-456c-9776-dabf0e2234b6 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:26.109464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f48d8dc3-343a-4f9b-9162-ddfa02cf3ad8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (e5b4827f-321c-456c-9776-dabf0e2234b6), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:26.110053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f48d8dc3-343a-4f9b-9162-ddfa02cf3ad8 admin admin] Security group rule updated ['6c3a2a03-88cd-40f3-acce-b7c2174a93cd'] Sep 25 00:57:27.242129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a0a5f66a-868f-4f6a-ad95-c1dbb32091f8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:57:27Z,description='Default security group',id=1c829fbf-5875-4dda-b22e-8efa807d0370,is_default=True,name='default',project_id='fe7866402a0745b6893cfa838864cfe7',revision_number=1,rules=[SecurityGroupRule(122af579-af8d-472c-85f2-45a1ad92add1),SecurityGroupRule(72b8d250-a81e-4370-9b67-9085db7a14ae),SecurityGroupRule(8331ae45-0c0c-4a23-992b-223f2282ef03),SecurityGroupRule(96b729b4-dcb9-4511-82db-89cd3bec48f5)],shared=False,stateful=True,updated_at=2022-09-25T00:57:27Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:27.243182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a0a5f66a-868f-4f6a-ad95-c1dbb32091f8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (1c829fbf-5875-4dda-b22e-8efa807d0370), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:27.243971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a0a5f66a-868f-4f6a-ad95-c1dbb32091f8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:27Z,description=,direction='egress',ethertype='IPv6',id=122af579-af8d-472c-85f2-45a1ad92add1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fe7866402a0745b6893cfa838864cfe7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1c829fbf-5875-4dda-b22e-8efa807d0370,updated_at=2022-09-25T00:57:27Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:27.244517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a0a5f66a-868f-4f6a-ad95-c1dbb32091f8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (122af579-af8d-472c-85f2-45a1ad92add1), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:27.245007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a0a5f66a-868f-4f6a-ad95-c1dbb32091f8 admin admin] Security group rule updated ['1c829fbf-5875-4dda-b22e-8efa807d0370'] Sep 25 00:57:27.245880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a0a5f66a-868f-4f6a-ad95-c1dbb32091f8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:27Z,description=,direction='ingress',ethertype='IPv4',id=72b8d250-a81e-4370-9b67-9085db7a14ae,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fe7866402a0745b6893cfa838864cfe7',protocol=,remote_address_group_id=,remote_group_id=1c829fbf-5875-4dda-b22e-8efa807d0370,remote_ip_prefix=,revision_number=0,security_group_id=1c829fbf-5875-4dda-b22e-8efa807d0370,updated_at=2022-09-25T00:57:27Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:27.246393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a0a5f66a-868f-4f6a-ad95-c1dbb32091f8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (72b8d250-a81e-4370-9b67-9085db7a14ae), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:27.246866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a0a5f66a-868f-4f6a-ad95-c1dbb32091f8 admin admin] Security group rule updated ['1c829fbf-5875-4dda-b22e-8efa807d0370'] Sep 25 00:57:27.248181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a0a5f66a-868f-4f6a-ad95-c1dbb32091f8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:27Z,description=,direction='ingress',ethertype='IPv6',id=8331ae45-0c0c-4a23-992b-223f2282ef03,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fe7866402a0745b6893cfa838864cfe7',protocol=,remote_address_group_id=,remote_group_id=1c829fbf-5875-4dda-b22e-8efa807d0370,remote_ip_prefix=,revision_number=0,security_group_id=1c829fbf-5875-4dda-b22e-8efa807d0370,updated_at=2022-09-25T00:57:27Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:27.248701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a0a5f66a-868f-4f6a-ad95-c1dbb32091f8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (8331ae45-0c0c-4a23-992b-223f2282ef03), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:27.249189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a0a5f66a-868f-4f6a-ad95-c1dbb32091f8 admin admin] Security group rule updated ['1c829fbf-5875-4dda-b22e-8efa807d0370'] Sep 25 00:57:27.250016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a0a5f66a-868f-4f6a-ad95-c1dbb32091f8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:27Z,description=,direction='egress',ethertype='IPv4',id=96b729b4-dcb9-4511-82db-89cd3bec48f5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fe7866402a0745b6893cfa838864cfe7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1c829fbf-5875-4dda-b22e-8efa807d0370,updated_at=2022-09-25T00:57:27Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:27.250526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a0a5f66a-868f-4f6a-ad95-c1dbb32091f8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (96b729b4-dcb9-4511-82db-89cd3bec48f5), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:27.251017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a0a5f66a-868f-4f6a-ad95-c1dbb32091f8 admin admin] Security group rule updated ['1c829fbf-5875-4dda-b22e-8efa807d0370'] Sep 25 00:57:27.423751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["21571eb0-a6f4-442e-992d-14305209bbe6","delete","qr-a66f06df-0c",16,["map",[["attached-mac","fa:16:3e:ce:99:32"],["iface-id","a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:57:27.466090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9483d3ea-65b4-4570-90bb-9a4a2d78a41c admin admin] Resource SecurityGroup deleted: 1c829fbf-5875-4dda-b22e-8efa807d0370 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:27.466856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9483d3ea-65b4-4570-90bb-9a4a2d78a41c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (1c829fbf-5875-4dda-b22e-8efa807d0370), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:27.468306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9483d3ea-65b4-4570-90bb-9a4a2d78a41c admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('1c829fbf-5875-4dda-b22e-8efa807d0370',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:57:27.488669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9483d3ea-65b4-4570-90bb-9a4a2d78a41c admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('1c829fbf-5875-4dda-b22e-8efa807d0370',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:57:27.488669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9483d3ea-65b4-4570-90bb-9a4a2d78a41c admin admin] Resource SecurityGroupRule deleted: 122af579-af8d-472c-85f2-45a1ad92add1 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:27.489491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9483d3ea-65b4-4570-90bb-9a4a2d78a41c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (122af579-af8d-472c-85f2-45a1ad92add1), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:27.490462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9483d3ea-65b4-4570-90bb-9a4a2d78a41c admin admin] Security group rule updated ['1c829fbf-5875-4dda-b22e-8efa807d0370'] Sep 25 00:57:27.490462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9483d3ea-65b4-4570-90bb-9a4a2d78a41c admin admin] Resource SecurityGroupRule deleted: 72b8d250-a81e-4370-9b67-9085db7a14ae {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:27.491167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9483d3ea-65b4-4570-90bb-9a4a2d78a41c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (72b8d250-a81e-4370-9b67-9085db7a14ae), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:27.491762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9483d3ea-65b4-4570-90bb-9a4a2d78a41c admin admin] Security group rule updated ['1c829fbf-5875-4dda-b22e-8efa807d0370'] Sep 25 00:57:27.492315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9483d3ea-65b4-4570-90bb-9a4a2d78a41c admin admin] Resource SecurityGroupRule deleted: 8331ae45-0c0c-4a23-992b-223f2282ef03 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:27.492532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9483d3ea-65b4-4570-90bb-9a4a2d78a41c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (8331ae45-0c0c-4a23-992b-223f2282ef03), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:27.492871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9483d3ea-65b4-4570-90bb-9a4a2d78a41c admin admin] Security group rule updated ['1c829fbf-5875-4dda-b22e-8efa807d0370'] Sep 25 00:57:27.494882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9483d3ea-65b4-4570-90bb-9a4a2d78a41c admin admin] Resource SecurityGroupRule deleted: 96b729b4-dcb9-4511-82db-89cd3bec48f5 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:27.495392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9483d3ea-65b4-4570-90bb-9a4a2d78a41c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (96b729b4-dcb9-4511-82db-89cd3bec48f5), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:27.497514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9483d3ea-65b4-4570-90bb-9a4a2d78a41c admin admin] Security group rule updated ['1c829fbf-5875-4dda-b22e-8efa807d0370'] Sep 25 00:57:27.633752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:298 started Sep 25 00:57:27.657651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b50f7eee-d4e1-4f66-b3a2-1f3928b1833d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:57:27Z,description='Default security group',id=bdf7eab8-1557-4218-bbcf-0cb26eb9cfc7,is_default=True,name='default',project_id='46f19fd9ad1e4880961d1eee75883687',revision_number=1,rules=[SecurityGroupRule(596134b6-6e7c-43ba-859b-031c2a8ede38),SecurityGroupRule(795e84ab-e923-4271-9ab7-5abca6126d40),SecurityGroupRule(c6813459-470c-45df-9ac1-1ed3c69e2f19),SecurityGroupRule(cf3c8655-8325-437d-b48a-5931873a4c09)],shared=False,stateful=True,updated_at=2022-09-25T00:57:27Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:27.659957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b50f7eee-d4e1-4f66-b3a2-1f3928b1833d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (bdf7eab8-1557-4218-bbcf-0cb26eb9cfc7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:27.661214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b50f7eee-d4e1-4f66-b3a2-1f3928b1833d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:27Z,description=,direction='egress',ethertype='IPv6',id=596134b6-6e7c-43ba-859b-031c2a8ede38,normalized_cidr=None,port_range_max=,port_range_min=,project_id='46f19fd9ad1e4880961d1eee75883687',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=bdf7eab8-1557-4218-bbcf-0cb26eb9cfc7,updated_at=2022-09-25T00:57:27Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:27.661906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b50f7eee-d4e1-4f66-b3a2-1f3928b1833d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (596134b6-6e7c-43ba-859b-031c2a8ede38), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:27.662265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b50f7eee-d4e1-4f66-b3a2-1f3928b1833d admin admin] Security group rule updated ['bdf7eab8-1557-4218-bbcf-0cb26eb9cfc7'] Sep 25 00:57:27.664000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b50f7eee-d4e1-4f66-b3a2-1f3928b1833d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:27Z,description=,direction='ingress',ethertype='IPv4',id=795e84ab-e923-4271-9ab7-5abca6126d40,normalized_cidr=None,port_range_max=,port_range_min=,project_id='46f19fd9ad1e4880961d1eee75883687',protocol=,remote_address_group_id=,remote_group_id=bdf7eab8-1557-4218-bbcf-0cb26eb9cfc7,remote_ip_prefix=,revision_number=0,security_group_id=bdf7eab8-1557-4218-bbcf-0cb26eb9cfc7,updated_at=2022-09-25T00:57:27Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:27.665492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b50f7eee-d4e1-4f66-b3a2-1f3928b1833d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (795e84ab-e923-4271-9ab7-5abca6126d40), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:27.665841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b50f7eee-d4e1-4f66-b3a2-1f3928b1833d admin admin] Security group rule updated ['bdf7eab8-1557-4218-bbcf-0cb26eb9cfc7'] Sep 25 00:57:27.666533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b50f7eee-d4e1-4f66-b3a2-1f3928b1833d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:27Z,description=,direction='ingress',ethertype='IPv6',id=c6813459-470c-45df-9ac1-1ed3c69e2f19,normalized_cidr=None,port_range_max=,port_range_min=,project_id='46f19fd9ad1e4880961d1eee75883687',protocol=,remote_address_group_id=,remote_group_id=bdf7eab8-1557-4218-bbcf-0cb26eb9cfc7,remote_ip_prefix=,revision_number=0,security_group_id=bdf7eab8-1557-4218-bbcf-0cb26eb9cfc7,updated_at=2022-09-25T00:57:27Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:27.666892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b50f7eee-d4e1-4f66-b3a2-1f3928b1833d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (c6813459-470c-45df-9ac1-1ed3c69e2f19), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:27.667222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b50f7eee-d4e1-4f66-b3a2-1f3928b1833d admin admin] Security group rule updated ['bdf7eab8-1557-4218-bbcf-0cb26eb9cfc7'] Sep 25 00:57:27.667884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b50f7eee-d4e1-4f66-b3a2-1f3928b1833d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:27Z,description=,direction='egress',ethertype='IPv4',id=cf3c8655-8325-437d-b48a-5931873a4c09,normalized_cidr=None,port_range_max=,port_range_min=,project_id='46f19fd9ad1e4880961d1eee75883687',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=bdf7eab8-1557-4218-bbcf-0cb26eb9cfc7,updated_at=2022-09-25T00:57:27Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:27.668236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b50f7eee-d4e1-4f66-b3a2-1f3928b1833d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (cf3c8655-8325-437d-b48a-5931873a4c09), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:27.668565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b50f7eee-d4e1-4f66-b3a2-1f3928b1833d admin admin] Security group rule updated ['bdf7eab8-1557-4218-bbcf-0cb26eb9cfc7'] Sep 25 00:57:27.738401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df0d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=462000000,duration_sec=610,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:27.739126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:57:27.739681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:298 - starting polling. Elapsed:0.106 Sep 25 00:57:27.747022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:27.756828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834df0f,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 16}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:27.757149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:298 - port information retrieved. Elapsed:0.124 Sep 25 00:57:27.757715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '68a3f405-e599-4339-b2a8-058311132e20', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', '7d521366-e68f-48bd-a7a8-e2283117a2b7', 'fc7bb1a7-9a53-42b3-8205-cc1649a623f2', '5204c0c3-4410-4695-a405-b599292c4e80', 'b6b39056-a691-4ac9-a565-574d1c5a0cd5', '1b8115fa-df9f-4b13-830a-866086f1b68f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'de4727a2-569d-44c6-a53e-ecc89817f610'}, 'added': set(), 'removed': {'a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6'}, 'updated': set(), 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:57:27.762082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:298 - agent port security group processed in 0.000 Sep 25 00:57:27.770775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up [] and devices down [] completed. Sep 25 00:57:27.771291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for {'a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6'} Sep 25 00:57:27.774322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 4 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:57:27.808439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c3ccb036-22c6-4672-bb84-fb2933cb8c22 admin admin] Resource Port deleted: b6b39056-a691-4ac9-a565-574d1c5a0cd5 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:27.809004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c3ccb036-22c6-4672-bb84-fb2933cb8c22 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (b6b39056-a691-4ac9-a565-574d1c5a0cd5), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:27.830935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4efdd3-80c8-4c8c-a0f7-966f931de73a]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:57:27.832079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Ports {'a66f06df-0cf4-4ab8-a51d-1a7e5c913ae6'} removed Sep 25 00:57:27.890591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port removal failed for set() {{(pid=107261) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 25 00:57:27.891556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:298 - treat_devices_removed completed in 0.120 Sep 25 00:57:27.892007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:298 - ports processed. Elapsed:0.258 Sep 25 00:57:27.892719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:298 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.259 Sep 25 00:57:27.965093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0a41f8c5-b8eb-47bc-be92-3a576da54455","delete","qg-b6b39056-a6",11,["map",[["attached-mac","fa:16:3e:30:b6:c0"],["iface-id","b6b39056-a691-4ac9-a565-574d1c5a0cd5"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:57:28.042965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b50f7eee-d4e1-4f66-b3a2-1f3928b1833d admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-25T00:57:27Z,description='',dns_domain=None,id=31fa7821-6345-4f48-b070-9ceab6d12adf,mtu=1500,name='tempest-TestVolumeBootPattern-420282573-network',project_id='46f19fd9ad1e4880961d1eee75883687',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(31fa7821-6345-4f48-b070-9ceab6d12adf),segments=[NetworkSegment(5580d2ab-1c02-4162-bded-4b179649cc54)],shared=False,status='ACTIVE',updated_at=2022-09-25T00:57:27Z,vlan_transparent=) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:28.043311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b50f7eee-d4e1-4f66-b3a2-1f3928b1833d admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (31fa7821-6345-4f48-b070-9ceab6d12adf), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:28.403287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager [None req-b50f7eee-d4e1-4f66-b3a2-1f3928b1833d admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 31fa7821-6345-4f48-b070-9ceab6d12adf with segmentation id not found. Sep 25 00:57:28.403287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 25 00:57:28.403287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 25 00:57:28.403287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 25 00:57:28.403287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 25 00:57:28.403287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 25 00:57:28.403287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 25 00:57:28.403287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 25 00:57:28.403287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 25 00:57:28.403287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 25 00:57:28.403287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 25 00:57:28.403287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 25 00:57:28.403287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 25 00:57:28.404742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 25 00:57:28.404742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 25 00:57:28.404742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 25 00:57:28.404742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 31fa7821-6345-4f48-b070-9ceab6d12adf with segmentation id not found. Sep 25 00:57:28.404742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Sep 25 00:57:28.510158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0d135add-fbf8-4e6b-86d4-1db832df0ff7 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(01d4c8bd-01c7-4206-84f5-1e51ca268c98)],cidr=172.20.0.0/28,created_at=2022-09-25T00:57:28Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=d10d11e6-b8a0-482d-9762-c8b3bdb048d3,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestVolumeBootPattern-420282573-subnet',network_id=31fa7821-6345-4f48-b070-9ceab6d12adf,project_id='46f19fd9ad1e4880961d1eee75883687',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-25T00:57:28Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:28.510548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0d135add-fbf8-4e6b-86d4-1db832df0ff7 admin admin] Publish callbacks [] for Subnet (d10d11e6-b8a0-482d-9762-c8b3bdb048d3), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:28.610035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ec83c46d-e434-431e-8e45-a2cfd542e60d admin admin] Resource Subnet deleted: d4d50c9e-21e6-4b33-9f79-09c2d9887013 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:28.613017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ec83c46d-e434-431e-8e45-a2cfd542e60d admin admin] Publish callbacks [] for Subnet (d4d50c9e-21e6-4b33-9f79-09c2d9887013), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:29.001180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["66e34c04-e3da-4ff7-8d35-2c32dfca3226","delete","tapfc7bb1a7-9a",7,["map",[["attached-mac","fa:16:3e:5a:0b:ce"],["iface-id","fc7bb1a7-9a53-42b3-8205-cc1649a623f2"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:57:29.145477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-02aeb285-5e9a-4b9f-baca-26bc1f2221b6 admin admin] Resource Port deleted: fc7bb1a7-9a53-42b3-8205-cc1649a623f2 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:29.147821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-02aeb285-5e9a-4b9f-baca-26bc1f2221b6 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (fc7bb1a7-9a53-42b3-8205-cc1649a623f2), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:29.444945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a5efd6d6-d3f3-4ed1-9d94-b7e11922843a None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:57:28Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-31fa7821-6345-4f48-b070-9ceab6d12adf',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=9f8092b0-2114-41f4-953a-0c53e92ff7ba,mac_address=fa:16:3e:23:17:d5,name='',network_id=31fa7821-6345-4f48-b070-9ceab6d12adf,numa_affinity_policy=,project_id='46f19fd9ad1e4880961d1eee75883687',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(9f8092b0-2114-41f4-953a-0c53e92ff7ba),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:57:29Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:29.446313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a5efd6d6-d3f3-4ed1-9d94-b7e11922843a None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (9f8092b0-2114-41f4-953a-0c53e92ff7ba), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:29.631573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-02aeb285-5e9a-4b9f-baca-26bc1f2221b6 admin admin] Resource Network deleted: c3254d23-d48a-485d-a0e8-5f41e3baa079 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:29.632172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-02aeb285-5e9a-4b9f-baca-26bc1f2221b6 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (c3254d23-d48a-485d-a0e8-5f41e3baa079), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:29.634291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:299 started Sep 25 00:57:29.640384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df11,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=366000000,duration_sec=612,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:29.640993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:57:29.641437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:299 - starting polling. Elapsed:0.007 Sep 25 00:57:29.643466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:29.651657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834df13,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 11}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:29.654390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834df15,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 7}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:29.655061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:299 - port information retrieved. Elapsed:0.021 Sep 25 00:57:29.655652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '68a3f405-e599-4339-b2a8-058311132e20', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', '7d521366-e68f-48bd-a7a8-e2283117a2b7', '5204c0c3-4410-4695-a405-b599292c4e80', '1b8115fa-df9f-4b13-830a-866086f1b68f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'de4727a2-569d-44c6-a53e-ecc89817f610'}, 'added': set(), 'removed': {'b6b39056-a691-4ac9-a565-574d1c5a0cd5', 'fc7bb1a7-9a53-42b3-8205-cc1649a623f2'}, 'updated': set(), 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:57:29.656146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:299 - agent port security group processed in 0.000 Sep 25 00:57:29.658238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up [] and devices down [] completed. Sep 25 00:57:29.658740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for {'b6b39056-a691-4ac9-a565-574d1c5a0cd5', 'fc7bb1a7-9a53-42b3-8205-cc1649a623f2'} Sep 25 00:57:29.659394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 8 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:57:29.743523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa1561e-007e-476f-a51a-e25498b76f66]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:57:29.744372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Ports {'b6b39056-a691-4ac9-a565-574d1c5a0cd5', 'fc7bb1a7-9a53-42b3-8205-cc1649a623f2'} removed Sep 25 00:57:29.828100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port removal failed for set() {{(pid=107261) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 25 00:57:29.828578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Reclaiming vlan = 5 from net-id = c3254d23-d48a-485d-a0e8-5f41e3baa079, seg-id = 96 Sep 25 00:57:29.835058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xa5d7ab44,OFPFlowMod(buffer_id=4294967295,command=3,cookie=13979250796582379444,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4101}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:29.838200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x7834df17,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4192}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:29.838526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:299 - treat_devices_removed completed in 0.180 Sep 25 00:57:29.838815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:299 - ports processed. Elapsed:0.205 Sep 25 00:57:29.839214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:299 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.205 Sep 25 00:57:29.869345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a5efd6d6-d3f3-4ed1-9d94-b7e11922843a None None] Resource Port 9f8092b0-2114-41f4-953a-0c53e92ff7ba updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=9f8092b0-2114-41f4-953a-0c53e92ff7ba,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=9f8092b0-2114-41f4-953a-0c53e92ff7ba,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=9f8092b0-2114-41f4-953a-0c53e92ff7ba,segment=NetworkSegment(5580d2ab-1c02-4162-bded-4b179649cc54),segment_id=5580d2ab-1c02-4162-bded-4b179649cc54)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:57:29.869345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a5efd6d6-d3f3-4ed1-9d94-b7e11922843a None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (9f8092b0-2114-41f4-953a-0c53e92ff7ba), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:29.958774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["bcee08d7-d53b-4e22-a835-09abbe590202","insert","tap9f8092b0-21",["set",[]],["map",[["attached-mac","fa:16:3e:23:17:d5"],["iface-id","9f8092b0-2114-41f4-953a-0c53e92ff7ba"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:57:29.983996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["bcee08d7-d53b-4e22-a835-09abbe590202","old",null,["set",[]],null],["","new","tap9f8092b0-21",18,["map",[["attached-mac","fa:16:3e:23:17:d5"],["iface-id","9f8092b0-2114-41f4-953a-0c53e92ff7ba"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:57:30.093699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d5551152-61d7-4d3b-aeda-0cce6ee6ae61 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:57:29Z,data_plane_status=None,description='',device_id='9e2086bf-7151-4c61-ae36-64793ffb6425',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=d2abc674-9be0-4d84-bba8-aeef142e4a64,mac_address=fa:16:3e:d7:42:a2,name='',network_id=62195cd6-54fa-4e24-9d47-ae0de6356ac2,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(d2abc674-9be0-4d84-bba8-aeef142e4a64),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:57:29Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:30.094187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d5551152-61d7-4d3b-aeda-0cce6ee6ae61 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (d2abc674-9be0-4d84-bba8-aeef142e4a64), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:30.218032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-46821e0a-13a3-4652-a5c6-b2bb5b7aeeaa admin admin] Resource SecurityGroup deleted: 33e8b406-0d9d-4791-be58-7ab180367bdc {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:30.218828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-46821e0a-13a3-4652-a5c6-b2bb5b7aeeaa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (33e8b406-0d9d-4791-be58-7ab180367bdc), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:30.219428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46821e0a-13a3-4652-a5c6-b2bb5b7aeeaa admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('33e8b406-0d9d-4791-be58-7ab180367bdc',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:57:30.254081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-46821e0a-13a3-4652-a5c6-b2bb5b7aeeaa admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('33e8b406-0d9d-4791-be58-7ab180367bdc',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:57:30.254534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-46821e0a-13a3-4652-a5c6-b2bb5b7aeeaa admin admin] Resource SecurityGroupRule deleted: 053bc846-8c38-4371-84fd-22fd0dcc31fa {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:30.254905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-46821e0a-13a3-4652-a5c6-b2bb5b7aeeaa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (053bc846-8c38-4371-84fd-22fd0dcc31fa), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:30.255394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-46821e0a-13a3-4652-a5c6-b2bb5b7aeeaa admin admin] Security group rule updated ['33e8b406-0d9d-4791-be58-7ab180367bdc'] Sep 25 00:57:30.255729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-46821e0a-13a3-4652-a5c6-b2bb5b7aeeaa admin admin] Resource SecurityGroupRule deleted: 33ddf804-d1cd-4d45-9735-f06d45cb147f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:30.256075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-46821e0a-13a3-4652-a5c6-b2bb5b7aeeaa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (33ddf804-d1cd-4d45-9735-f06d45cb147f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:30.257373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-46821e0a-13a3-4652-a5c6-b2bb5b7aeeaa admin admin] Security group rule updated ['33e8b406-0d9d-4791-be58-7ab180367bdc'] Sep 25 00:57:30.257773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-46821e0a-13a3-4652-a5c6-b2bb5b7aeeaa admin admin] Resource SecurityGroupRule deleted: 57d88bec-a3ea-447c-af22-1213688c1312 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:30.258344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-46821e0a-13a3-4652-a5c6-b2bb5b7aeeaa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (57d88bec-a3ea-447c-af22-1213688c1312), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:30.259832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-46821e0a-13a3-4652-a5c6-b2bb5b7aeeaa admin admin] Security group rule updated ['33e8b406-0d9d-4791-be58-7ab180367bdc'] Sep 25 00:57:30.260451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-46821e0a-13a3-4652-a5c6-b2bb5b7aeeaa admin admin] Resource SecurityGroupRule deleted: b5935d81-53d0-41c4-a5cf-8e594029fdda {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:30.261029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-46821e0a-13a3-4652-a5c6-b2bb5b7aeeaa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (b5935d81-53d0-41c4-a5cf-8e594029fdda), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:30.261446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-46821e0a-13a3-4652-a5c6-b2bb5b7aeeaa admin admin] Security group rule updated ['33e8b406-0d9d-4791-be58-7ab180367bdc'] Sep 25 00:57:31.635268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:300 started Sep 25 00:57:31.641578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df19,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=365000000,duration_sec=614,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:31.642413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:57:31.643877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:300 - starting polling. Elapsed:0.009 Sep 25 00:57:31.647483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:31.651620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:300 - port information retrieved. Elapsed:0.017 Sep 25 00:57:31.652297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '68a3f405-e599-4339-b2a8-058311132e20', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', '7d521366-e68f-48bd-a7a8-e2283117a2b7', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', '5204c0c3-4410-4695-a405-b599292c4e80', '1b8115fa-df9f-4b13-830a-866086f1b68f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'de4727a2-569d-44c6-a53e-ecc89817f610'}, 'added': {'9f8092b0-2114-41f4-953a-0c53e92ff7ba'}, 'removed': set(), 'updated': {'9f8092b0-2114-41f4-953a-0c53e92ff7ba'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:57:31.653200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-31fa7821-6345-4f48-b070-9ceab6d12adf', 'network_id': '31fa7821-6345-4f48-b070-9ceab6d12adf', 'port_id': '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'mac_address': 'fa:16:3e:23:17:d5', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 59, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd10d11e6-b8a0-482d-9762-c8b3bdb048d3', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:57:31.656430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 9f8092b0-2114-41f4-953a-0c53e92ff7ba {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:57:31.656941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 9f8092b0-2114-41f4-953a-0c53e92ff7ba updated. Details: {'device': '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-31fa7821-6345-4f48-b070-9ceab6d12adf', 'network_id': '31fa7821-6345-4f48-b070-9ceab6d12adf', 'port_id': '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'mac_address': 'fa:16:3e:23:17:d5', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 59, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd10d11e6-b8a0-482d-9762-c8b3bdb048d3', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 25 00:57:31.657484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Assigning 8 as local vlan for net-id=31fa7821-6345-4f48-b070-9ceab6d12adf, seg-id=59 Sep 25 00:57:31.663482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xa5d7ab46,OFPFlowMod(buffer_id=4294967295,command=0,cookie=13979250796582379444,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4155), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4104}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:31.667802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x7834df1b,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4104)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4155}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:31.669166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap9f8092b0-21, col_values=(('tag', 8),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:31.670270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap9f8092b0-21, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:31.670880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap9f8092b0-21, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:31.682995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap9f8092b0-21, col_values=(('other_config', {'net_uuid': '31fa7821-6345-4f48-b070-9ceab6d12adf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '8', 'segmentation_id': '59'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:31.697934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834df1d,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 18}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:31.698310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:300 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 14 devices currently available. Time elapsed: 0.045 Sep 25 00:57:31.699078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing device filters for 1 new devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 25 00:57:31.699587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing filters for devices {'9f8092b0-2114-41f4-953a-0c53e92ff7ba'} Sep 25 00:57:31.702829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:57:31.703361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:57:31.712766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:57:31.720369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-69349fc5-0ae1-401e-b21b-469ea8523b6c None None] Resource Port 9f8092b0-2114-41f4-953a-0c53e92ff7ba updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:57:31.721104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-69349fc5-0ae1-401e-b21b-469ea8523b6c None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (9f8092b0-2114-41f4-953a-0c53e92ff7ba), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:31.776171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[89531d88-0dae-4564-a09d-d7185340a793]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:57:31.777149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:300 - agent port security group processed in 0.124 Sep 25 00:57:31.778065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 9f8092b0-2114-41f4-953a-0c53e92ff7ba to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:57:32.227371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1e759726-733e-40bc-bc78-02abf32fafb8 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:57:31Z,data_plane_status=None,description='',device_id='9e2086bf-7151-4c61-ae36-64793ffb6425',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=4a688d1f-1335-463f-b319-bcba153c442f,mac_address=fa:16:3e:dc:95:fe,name='',network_id=31fa7821-6345-4f48-b070-9ceab6d12adf,numa_affinity_policy=,project_id='46f19fd9ad1e4880961d1eee75883687',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(4a688d1f-1335-463f-b319-bcba153c442f),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:57:31Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:32.230833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1e759726-733e-40bc-bc78-02abf32fafb8 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (4a688d1f-1335-463f-b319-bcba153c442f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:32.314757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['9f8092b0-2114-41f4-953a-0c53e92ff7ba'] and devices down [] completed. Sep 25 00:57:32.315803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:300 - ports processed. Elapsed:0.681 Sep 25 00:57:32.316377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:300 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.681 Sep 25 00:57:32.520179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f96425cb-5128-4005-9d93-2f5942d66dc8 None None] Resource Port d2abc674-9be0-4d84-bba8-aeef142e4a64 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=d2abc674-9be0-4d84-bba8-aeef142e4a64,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=d2abc674-9be0-4d84-bba8-aeef142e4a64,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:57:32.523176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f96425cb-5128-4005-9d93-2f5942d66dc8 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (d2abc674-9be0-4d84-bba8-aeef142e4a64), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:32.830978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f96425cb-5128-4005-9d93-2f5942d66dc8 None None] Resource Port d2abc674-9be0-4d84-bba8-aeef142e4a64 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=d2abc674-9be0-4d84-bba8-aeef142e4a64,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=d2abc674-9be0-4d84-bba8-aeef142e4a64,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=d2abc674-9be0-4d84-bba8-aeef142e4a64,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:57:32.833012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f96425cb-5128-4005-9d93-2f5942d66dc8 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (d2abc674-9be0-4d84-bba8-aeef142e4a64), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:32.931791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1e759726-733e-40bc-bc78-02abf32fafb8 admin admin] Received resource Port update without any changes: 4a688d1f-1335-463f-b319-bcba153c442f {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 25 00:57:33.646797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:301 started Sep 25 00:57:33.647989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["e5a81c94-dd46-4b89-ba18-21fbdc5310b0","insert","qr-4a688d1f-13",["set",[]],["map",[["attached-mac","fa:16:3e:dc:95:fe"],["iface-id","4a688d1f-1335-463f-b319-bcba153c442f"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:57:33.649286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["e5a81c94-dd46-4b89-ba18-21fbdc5310b0","old",null,["set",[]],null],["","new","qr-4a688d1f-13",19,["map",[["attached-mac","fa:16:3e:dc:95:fe"],["iface-id","4a688d1f-1335-463f-b319-bcba153c442f"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:57:33.654688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df1f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=377000000,duration_sec=616,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:33.655293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:57:33.658024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:301 - starting polling. Elapsed:0.011 Sep 25 00:57:33.662577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:33.665894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:301 - port information retrieved. Elapsed:0.019 Sep 25 00:57:33.666298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', '4a688d1f-1335-463f-b319-bcba153c442f', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '1b8115fa-df9f-4b13-830a-866086f1b68f', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '68a3f405-e599-4339-b2a8-058311132e20', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', '7d521366-e68f-48bd-a7a8-e2283117a2b7', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'de4727a2-569d-44c6-a53e-ecc89817f610', '5204c0c3-4410-4695-a405-b599292c4e80'}, 'added': {'4a688d1f-1335-463f-b319-bcba153c442f'}, 'removed': set(), 'updated': {'4a688d1f-1335-463f-b319-bcba153c442f', '9f8092b0-2114-41f4-953a-0c53e92ff7ba'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:57:33.666976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: WARNING neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:57:31Z,data_plane_status=None,description='',device_id='9e2086bf-7151-4c61-ae36-64793ffb6425',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=4a688d1f-1335-463f-b319-bcba153c442f,mac_address=fa:16:3e:dc:95:fe,name='',network_id=31fa7821-6345-4f48-b070-9ceab6d12adf,numa_affinity_policy=,project_id='46f19fd9ad1e4880961d1eee75883687',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(4a688d1f-1335-463f-b319-bcba153c442f),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:57:32Z) is not bound. Sep 25 00:57:33.667591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-31fa7821-6345-4f48-b070-9ceab6d12adf', 'network_id': '31fa7821-6345-4f48-b070-9ceab6d12adf', 'port_id': '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'mac_address': 'fa:16:3e:23:17:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 59, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd10d11e6-b8a0-482d-9762-c8b3bdb048d3', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:57:33.671529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 4a688d1f-1335-463f-b319-bcba153c442f {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:57:33.671834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Device 4a688d1f-1335-463f-b319-bcba153c442f not defined on plugin or binding failed Sep 25 00:57:33.672369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 9f8092b0-2114-41f4-953a-0c53e92ff7ba {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:57:33.672746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 9f8092b0-2114-41f4-953a-0c53e92ff7ba updated. Details: {'device': '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-31fa7821-6345-4f48-b070-9ceab6d12adf', 'network_id': '31fa7821-6345-4f48-b070-9ceab6d12adf', 'port_id': '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'mac_address': 'fa:16:3e:23:17:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 59, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd10d11e6-b8a0-482d-9762-c8b3bdb048d3', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 8} Sep 25 00:57:33.674981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap9f8092b0-21, col_values=(('tag', 8),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:33.675419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap9f8092b0-21, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:33.675871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap9f8092b0-21, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:33.676345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:57:33.678677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap9f8092b0-21, col_values=(('other_config', {'net_uuid': '31fa7821-6345-4f48-b070-9ceab6d12adf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '59', 'tag': '8'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:33.679388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:57:33.682408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834df21,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 18}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:33.683372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:301 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 15 devices currently available. Time elapsed: 0.017 Sep 25 00:57:33.683737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing device filters for 1 new devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 25 00:57:33.684125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing filters for devices {'4a688d1f-1335-463f-b319-bcba153c442f'} Sep 25 00:57:33.685336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:57:33.685629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:57:33.690165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refreshing firewall for 1 devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 25 00:57:33.690500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refresh firewall rules Sep 25 00:57:33.691665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:57:33.692370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:57:33.696266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:57:33.754578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-516fe3cb-f183-4b3b-b523-225344e69b94 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:57:33Z,description='Default security group',id=1363f41a-f3ad-4d49-ab41-5f374436b96f,is_default=True,name='default',project_id='f8f3e47fa0e04e77a29f2a3ef7566c80',revision_number=1,rules=[SecurityGroupRule(77574b72-139e-4d15-9b25-863fe1b03bff),SecurityGroupRule(a80c034b-a863-4618-b1af-e813368c1558),SecurityGroupRule(d62087dd-06d6-4f99-8d7b-5426c6a28afa),SecurityGroupRule(dc0863d5-8794-43c8-b2be-e4a9f10e1371)],shared=False,stateful=True,updated_at=2022-09-25T00:57:33Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:33.755213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-516fe3cb-f183-4b3b-b523-225344e69b94 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (1363f41a-f3ad-4d49-ab41-5f374436b96f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:33.755852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-516fe3cb-f183-4b3b-b523-225344e69b94 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:33Z,description=,direction='ingress',ethertype='IPv4',id=77574b72-139e-4d15-9b25-863fe1b03bff,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f8f3e47fa0e04e77a29f2a3ef7566c80',protocol=,remote_address_group_id=,remote_group_id=1363f41a-f3ad-4d49-ab41-5f374436b96f,remote_ip_prefix=,revision_number=0,security_group_id=1363f41a-f3ad-4d49-ab41-5f374436b96f,updated_at=2022-09-25T00:57:33Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:33.756221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-516fe3cb-f183-4b3b-b523-225344e69b94 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (77574b72-139e-4d15-9b25-863fe1b03bff), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:33.756565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-516fe3cb-f183-4b3b-b523-225344e69b94 admin admin] Security group rule updated ['1363f41a-f3ad-4d49-ab41-5f374436b96f'] Sep 25 00:57:33.758728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47c7a87-881b-49b6-964d-0ae31636db58]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:57:33.759971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:301 - agent port security group processed in 0.093 Sep 25 00:57:33.760738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 9f8092b0-2114-41f4-953a-0c53e92ff7ba to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:57:33.788806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-516fe3cb-f183-4b3b-b523-225344e69b94 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:33Z,description=,direction='egress',ethertype='IPv4',id=a80c034b-a863-4618-b1af-e813368c1558,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f8f3e47fa0e04e77a29f2a3ef7566c80',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1363f41a-f3ad-4d49-ab41-5f374436b96f,updated_at=2022-09-25T00:57:33Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:33.789193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-516fe3cb-f183-4b3b-b523-225344e69b94 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (a80c034b-a863-4618-b1af-e813368c1558), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:33.795799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-516fe3cb-f183-4b3b-b523-225344e69b94 admin admin] Security group rule updated ['1363f41a-f3ad-4d49-ab41-5f374436b96f'] Sep 25 00:57:33.797481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-516fe3cb-f183-4b3b-b523-225344e69b94 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:33Z,description=,direction='egress',ethertype='IPv6',id=d62087dd-06d6-4f99-8d7b-5426c6a28afa,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f8f3e47fa0e04e77a29f2a3ef7566c80',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1363f41a-f3ad-4d49-ab41-5f374436b96f,updated_at=2022-09-25T00:57:33Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:33.799346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-516fe3cb-f183-4b3b-b523-225344e69b94 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (d62087dd-06d6-4f99-8d7b-5426c6a28afa), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:33.800618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-516fe3cb-f183-4b3b-b523-225344e69b94 admin admin] Security group rule updated ['1363f41a-f3ad-4d49-ab41-5f374436b96f'] Sep 25 00:57:33.804296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-516fe3cb-f183-4b3b-b523-225344e69b94 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:33Z,description=,direction='ingress',ethertype='IPv6',id=dc0863d5-8794-43c8-b2be-e4a9f10e1371,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f8f3e47fa0e04e77a29f2a3ef7566c80',protocol=,remote_address_group_id=,remote_group_id=1363f41a-f3ad-4d49-ab41-5f374436b96f,remote_ip_prefix=,revision_number=0,security_group_id=1363f41a-f3ad-4d49-ab41-5f374436b96f,updated_at=2022-09-25T00:57:33Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:33.805600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-516fe3cb-f183-4b3b-b523-225344e69b94 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (dc0863d5-8794-43c8-b2be-e4a9f10e1371), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:33.807758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-516fe3cb-f183-4b3b-b523-225344e69b94 admin admin] Security group rule updated ['1363f41a-f3ad-4d49-ab41-5f374436b96f'] Sep 25 00:57:33.948198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9ea40755-dd94-4745-b655-09c7d5b816d6 admin admin] Resource SecurityGroup deleted: 1363f41a-f3ad-4d49-ab41-5f374436b96f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:33.948916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9ea40755-dd94-4745-b655-09c7d5b816d6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (1363f41a-f3ad-4d49-ab41-5f374436b96f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:33.949403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ea40755-dd94-4745-b655-09c7d5b816d6 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('1363f41a-f3ad-4d49-ab41-5f374436b96f',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:57:33.971058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['9f8092b0-2114-41f4-953a-0c53e92ff7ba'] and devices down [] completed. Sep 25 00:57:33.971823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:301 - ports processed. Elapsed:0.325 Sep 25 00:57:33.972246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:301 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 2, 'removed': 0}}. Elapsed:0.326 Sep 25 00:57:33.978565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9ea40755-dd94-4745-b655-09c7d5b816d6 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('1363f41a-f3ad-4d49-ab41-5f374436b96f',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:57:33.979366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9ea40755-dd94-4745-b655-09c7d5b816d6 admin admin] Resource SecurityGroupRule deleted: 77574b72-139e-4d15-9b25-863fe1b03bff {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:33.980291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9ea40755-dd94-4745-b655-09c7d5b816d6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (77574b72-139e-4d15-9b25-863fe1b03bff), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:33.980986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9ea40755-dd94-4745-b655-09c7d5b816d6 admin admin] Security group rule updated ['1363f41a-f3ad-4d49-ab41-5f374436b96f'] Sep 25 00:57:33.982406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9ea40755-dd94-4745-b655-09c7d5b816d6 admin admin] Resource SecurityGroupRule deleted: a80c034b-a863-4618-b1af-e813368c1558 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:33.982965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9ea40755-dd94-4745-b655-09c7d5b816d6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (a80c034b-a863-4618-b1af-e813368c1558), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:33.983487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9ea40755-dd94-4745-b655-09c7d5b816d6 admin admin] Security group rule updated ['1363f41a-f3ad-4d49-ab41-5f374436b96f'] Sep 25 00:57:33.984038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9ea40755-dd94-4745-b655-09c7d5b816d6 admin admin] Resource SecurityGroupRule deleted: d62087dd-06d6-4f99-8d7b-5426c6a28afa {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:33.984567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9ea40755-dd94-4745-b655-09c7d5b816d6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (d62087dd-06d6-4f99-8d7b-5426c6a28afa), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:33.985063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9ea40755-dd94-4745-b655-09c7d5b816d6 admin admin] Security group rule updated ['1363f41a-f3ad-4d49-ab41-5f374436b96f'] Sep 25 00:57:33.985635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9ea40755-dd94-4745-b655-09c7d5b816d6 admin admin] Resource SecurityGroupRule deleted: dc0863d5-8794-43c8-b2be-e4a9f10e1371 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:57:33.986186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9ea40755-dd94-4745-b655-09c7d5b816d6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (dc0863d5-8794-43c8-b2be-e4a9f10e1371), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:33.986729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9ea40755-dd94-4745-b655-09c7d5b816d6 admin admin] Security group rule updated ['1363f41a-f3ad-4d49-ab41-5f374436b96f'] Sep 25 00:57:34.315500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a1ae14f9-ee9b-4b9e-8147-0c626361442b","insert","qg-d2abc674-9b",["set",[]],["map",[["attached-mac","fa:16:3e:d7:42:a2"],["iface-id","d2abc674-9be0-4d84-bba8-aeef142e4a64"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:57:34.338250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a1ae14f9-ee9b-4b9e-8147-0c626361442b","old",null,["set",[]],null],["","new","qg-d2abc674-9b",20,["map",[["attached-mac","fa:16:3e:d7:42:a2"],["iface-id","d2abc674-9be0-4d84-bba8-aeef142e4a64"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:57:34.802220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6f92b6c5-a4b6-4796-810f-2f778a3465a0 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:57:34Z,description='Default security group',id=492dbb31-9757-44c7-b90f-65bdee6f6e5f,is_default=True,name='default',project_id='adf4f7abd15d45d1a06405bdb1e94eef',revision_number=1,rules=[SecurityGroupRule(4176b4c7-fbaa-4cda-8ddb-f69b91140a91),SecurityGroupRule(6d864efc-bc00-42b9-9b9b-8afe48a9a86c),SecurityGroupRule(f34926eb-b92a-4ea6-84b3-9c371bffe620),SecurityGroupRule(fab3cf16-7300-4b16-8387-54d6b0ce4d4f)],shared=False,stateful=True,updated_at=2022-09-25T00:57:34Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:34.802841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6f92b6c5-a4b6-4796-810f-2f778a3465a0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (492dbb31-9757-44c7-b90f-65bdee6f6e5f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:34.803760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6f92b6c5-a4b6-4796-810f-2f778a3465a0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:34Z,description=,direction='egress',ethertype='IPv6',id=4176b4c7-fbaa-4cda-8ddb-f69b91140a91,normalized_cidr=None,port_range_max=,port_range_min=,project_id='adf4f7abd15d45d1a06405bdb1e94eef',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=492dbb31-9757-44c7-b90f-65bdee6f6e5f,updated_at=2022-09-25T00:57:34Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:34.804363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6f92b6c5-a4b6-4796-810f-2f778a3465a0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (4176b4c7-fbaa-4cda-8ddb-f69b91140a91), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:34.805594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-6f92b6c5-a4b6-4796-810f-2f778a3465a0 admin admin] Security group rule updated ['492dbb31-9757-44c7-b90f-65bdee6f6e5f'] Sep 25 00:57:34.808079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6f92b6c5-a4b6-4796-810f-2f778a3465a0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:34Z,description=,direction='egress',ethertype='IPv4',id=6d864efc-bc00-42b9-9b9b-8afe48a9a86c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='adf4f7abd15d45d1a06405bdb1e94eef',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=492dbb31-9757-44c7-b90f-65bdee6f6e5f,updated_at=2022-09-25T00:57:34Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:34.809147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6f92b6c5-a4b6-4796-810f-2f778a3465a0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (6d864efc-bc00-42b9-9b9b-8afe48a9a86c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:34.809945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-6f92b6c5-a4b6-4796-810f-2f778a3465a0 admin admin] Security group rule updated ['492dbb31-9757-44c7-b90f-65bdee6f6e5f'] Sep 25 00:57:34.813475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6f92b6c5-a4b6-4796-810f-2f778a3465a0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:34Z,description=,direction='ingress',ethertype='IPv6',id=f34926eb-b92a-4ea6-84b3-9c371bffe620,normalized_cidr=None,port_range_max=,port_range_min=,project_id='adf4f7abd15d45d1a06405bdb1e94eef',protocol=,remote_address_group_id=,remote_group_id=492dbb31-9757-44c7-b90f-65bdee6f6e5f,remote_ip_prefix=,revision_number=0,security_group_id=492dbb31-9757-44c7-b90f-65bdee6f6e5f,updated_at=2022-09-25T00:57:34Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:34.814107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6f92b6c5-a4b6-4796-810f-2f778a3465a0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f34926eb-b92a-4ea6-84b3-9c371bffe620), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:34.814636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-6f92b6c5-a4b6-4796-810f-2f778a3465a0 admin admin] Security group rule updated ['492dbb31-9757-44c7-b90f-65bdee6f6e5f'] Sep 25 00:57:34.815501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6f92b6c5-a4b6-4796-810f-2f778a3465a0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:34Z,description=,direction='ingress',ethertype='IPv4',id=fab3cf16-7300-4b16-8387-54d6b0ce4d4f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='adf4f7abd15d45d1a06405bdb1e94eef',protocol=,remote_address_group_id=,remote_group_id=492dbb31-9757-44c7-b90f-65bdee6f6e5f,remote_ip_prefix=,revision_number=0,security_group_id=492dbb31-9757-44c7-b90f-65bdee6f6e5f,updated_at=2022-09-25T00:57:34Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:34.817603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6f92b6c5-a4b6-4796-810f-2f778a3465a0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (fab3cf16-7300-4b16-8387-54d6b0ce4d4f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:34.818282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-6f92b6c5-a4b6-4796-810f-2f778a3465a0 admin admin] Security group rule updated ['492dbb31-9757-44c7-b90f-65bdee6f6e5f'] Sep 25 00:57:35.049394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6f92b6c5-a4b6-4796-810f-2f778a3465a0 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-25T00:57:34Z,description='',dns_domain=None,id=ca4cd8bc-b7e9-4c6f-bdc8-805e0843ee8e,mtu=1500,name='tempest-TestVolumeBootPattern-1547647165-network',project_id='adf4f7abd15d45d1a06405bdb1e94eef',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(ca4cd8bc-b7e9-4c6f-bdc8-805e0843ee8e),segments=[NetworkSegment(ada409c8-3cbd-4590-9fd7-70e3397de373)],shared=False,status='ACTIVE',updated_at=2022-09-25T00:57:34Z,vlan_transparent=) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:35.050055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6f92b6c5-a4b6-4796-810f-2f778a3465a0 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (ca4cd8bc-b7e9-4c6f-bdc8-805e0843ee8e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:35.192888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager [None req-6f92b6c5-a4b6-4796-810f-2f778a3465a0 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network ca4cd8bc-b7e9-4c6f-bdc8-805e0843ee8e with segmentation id not found. Sep 25 00:57:35.192888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 25 00:57:35.192888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 25 00:57:35.192888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 25 00:57:35.192888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 25 00:57:35.192888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 25 00:57:35.192888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 25 00:57:35.192888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 25 00:57:35.192888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 25 00:57:35.192888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 25 00:57:35.192888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 25 00:57:35.192888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 25 00:57:35.192888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 25 00:57:35.193995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 25 00:57:35.193995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 25 00:57:35.193995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 25 00:57:35.193995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network ca4cd8bc-b7e9-4c6f-bdc8-805e0843ee8e with segmentation id not found. Sep 25 00:57:35.193995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Sep 25 00:57:35.367769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ab68c92a-514b-42af-90be-6e7f3b4ed154 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(dc0efd57-c81d-4d94-8017-8b6b2a476f41)],cidr=172.20.0.0/28,created_at=2022-09-25T00:57:35Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=23b6c853-6aa6-4b19-9c76-ddde24e53ac3,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestVolumeBootPattern-1547647165-subnet',network_id=ca4cd8bc-b7e9-4c6f-bdc8-805e0843ee8e,project_id='adf4f7abd15d45d1a06405bdb1e94eef',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-25T00:57:35Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:35.368150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ab68c92a-514b-42af-90be-6e7f3b4ed154 admin admin] Publish callbacks [] for Subnet (23b6c853-6aa6-4b19-9c76-ddde24e53ac3), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:35.648443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:302 started Sep 25 00:57:35.653224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df23,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=378000000,duration_sec=618,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:35.654971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:57:35.655924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:302 - starting polling. Elapsed:0.008 Sep 25 00:57:35.658883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:35.663593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:302 - port information retrieved. Elapsed:0.016 Sep 25 00:57:35.665343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', '4a688d1f-1335-463f-b319-bcba153c442f', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '1b8115fa-df9f-4b13-830a-866086f1b68f', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '68a3f405-e599-4339-b2a8-058311132e20', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', '7d521366-e68f-48bd-a7a8-e2283117a2b7', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'de4727a2-569d-44c6-a53e-ecc89817f610', '5204c0c3-4410-4695-a405-b599292c4e80'}, 'added': {'d2abc674-9be0-4d84-bba8-aeef142e4a64'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:57:35.666188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'device_id': '9e2086bf-7151-4c61-ae36-64793ffb6425', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'mac_address': 'fa:16:3e:d7:42:a2', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.184'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:57:35.670885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: d2abc674-9be0-4d84-bba8-aeef142e4a64 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:57:35.671563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port d2abc674-9be0-4d84-bba8-aeef142e4a64 updated. Details: {'device': 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'device_id': '9e2086bf-7151-4c61-ae36-64793ffb6425', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'mac_address': 'fa:16:3e:d7:42:a2', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.184'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 25 00:57:35.673393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-d2abc674-9b, col_values=(('tag', 2),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:35.674035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-d2abc674-9b, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:35.674712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-d2abc674-9b, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:35.695608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-d2abc674-9b, col_values=(('other_config', {'net_uuid': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:35.712397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834df25,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 20}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:35.712998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:302 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 16 devices currently available. Time elapsed: 0.047 Sep 25 00:57:35.713528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing device filters for 1 new devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 25 00:57:35.713975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing filters for devices {'d2abc674-9be0-4d84-bba8-aeef142e4a64'} Sep 25 00:57:35.715321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:57:35.715763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:57:35.720603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:57:35.770365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca74b44-e011-4ed2-ac64-91ffcec5cac4]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:57:35.771450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:302 - agent port security group processed in 0.105 Sep 25 00:57:35.772382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for d2abc674-9be0-4d84-bba8-aeef142e4a64 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:57:36.076407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-58c8083e-4832-46df-ab39-81565485cd2b None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:57:35Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-ca4cd8bc-b7e9-4c6f-bdc8-805e0843ee8e',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=06b2816e-8529-43d4-82ae-6b0cacaeb5be,mac_address=fa:16:3e:d8:28:e0,name='',network_id=ca4cd8bc-b7e9-4c6f-bdc8-805e0843ee8e,numa_affinity_policy=,project_id='adf4f7abd15d45d1a06405bdb1e94eef',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(06b2816e-8529-43d4-82ae-6b0cacaeb5be),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:57:35Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:36.076996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-58c8083e-4832-46df-ab39-81565485cd2b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (06b2816e-8529-43d4-82ae-6b0cacaeb5be), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:36.146077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['d2abc674-9be0-4d84-bba8-aeef142e4a64'] and devices down [] completed. Sep 25 00:57:36.146077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:302 - ports processed. Elapsed:0.498 Sep 25 00:57:36.146244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:302 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:0.498 Sep 25 00:57:36.231565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Resource Port d2abc674-9be0-4d84-bba8-aeef142e4a64 updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=d2abc674-9be0-4d84-bba8-aeef142e4a64,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=d2abc674-9be0-4d84-bba8-aeef142e4a64,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)], 'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:57:36.231956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (d2abc674-9be0-4d84-bba8-aeef142e4a64), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:36.426842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-58c8083e-4832-46df-ab39-81565485cd2b None None] Resource Port 06b2816e-8529-43d4-82ae-6b0cacaeb5be updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=06b2816e-8529-43d4-82ae-6b0cacaeb5be,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=06b2816e-8529-43d4-82ae-6b0cacaeb5be,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=06b2816e-8529-43d4-82ae-6b0cacaeb5be,segment=NetworkSegment(ada409c8-3cbd-4590-9fd7-70e3397de373),segment_id=ada409c8-3cbd-4590-9fd7-70e3397de373)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:57:36.427393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-58c8083e-4832-46df-ab39-81565485cd2b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (06b2816e-8529-43d4-82ae-6b0cacaeb5be), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:36.543812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["6571cd8d-27f4-4a71-8ddd-8462d51dd92d","insert","tap06b2816e-85",["set",[]],["map",[["attached-mac","fa:16:3e:d8:28:e0"],["iface-id","06b2816e-8529-43d4-82ae-6b0cacaeb5be"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:57:36.561248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["6571cd8d-27f4-4a71-8ddd-8462d51dd92d","old",null,["set",[]],null],["","new","tap06b2816e-85",21,["map",[["attached-mac","fa:16:3e:d8:28:e0"],["iface-id","06b2816e-8529-43d4-82ae-6b0cacaeb5be"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:57:36.584772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c7364320-1980-4c7b-aaef-352803e22413 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:57:36Z,data_plane_status=None,description='',device_id='6a441b6e-5258-48de-ac7a-ae9b0fcfa8c6',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=783df414-cffa-4596-a921-2b930804680d,mac_address=fa:16:3e:ab:c1:14,name='',network_id=62195cd6-54fa-4e24-9d47-ae0de6356ac2,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(783df414-cffa-4596-a921-2b930804680d),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:57:36Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:36.585158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c7364320-1980-4c7b-aaef-352803e22413 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (783df414-cffa-4596-a921-2b930804680d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:37.079085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-14f0b7ee-9f7d-45fd-90dc-8937471a7b81 None None] Resource Port 4a688d1f-1335-463f-b319-bcba153c442f updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=4a688d1f-1335-463f-b319-bcba153c442f,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=4a688d1f-1335-463f-b319-bcba153c442f,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:57:37.079622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-14f0b7ee-9f7d-45fd-90dc-8937471a7b81 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (4a688d1f-1335-463f-b319-bcba153c442f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:37.328497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-14f0b7ee-9f7d-45fd-90dc-8937471a7b81 None None] Resource Port 4a688d1f-1335-463f-b319-bcba153c442f updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=4a688d1f-1335-463f-b319-bcba153c442f,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=4a688d1f-1335-463f-b319-bcba153c442f,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=4a688d1f-1335-463f-b319-bcba153c442f,segment=NetworkSegment(5580d2ab-1c02-4162-bded-4b179649cc54),segment_id=5580d2ab-1c02-4162-bded-4b179649cc54)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:57:37.329279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-14f0b7ee-9f7d-45fd-90dc-8937471a7b81 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (4a688d1f-1335-463f-b319-bcba153c442f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:37.648788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:303 started Sep 25 00:57:37.656137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df27,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=378000000,duration_sec=620,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:37.656743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:57:37.657279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:303 - starting polling. Elapsed:0.009 Sep 25 00:57:37.659734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:37.668743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:303 - port information retrieved. Elapsed:0.019 Sep 25 00:57:37.669331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '68a3f405-e599-4339-b2a8-058311132e20', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', '7d521366-e68f-48bd-a7a8-e2283117a2b7', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '4a688d1f-1335-463f-b319-bcba153c442f', '1b8115fa-df9f-4b13-830a-866086f1b68f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'de4727a2-569d-44c6-a53e-ecc89817f610'}, 'added': {'06b2816e-8529-43d4-82ae-6b0cacaeb5be'}, 'removed': set(), 'updated': {'4a688d1f-1335-463f-b319-bcba153c442f', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', '06b2816e-8529-43d4-82ae-6b0cacaeb5be'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:57:37.671301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '4a688d1f-1335-463f-b319-bcba153c442f', 'device_id': '9e2086bf-7151-4c61-ae36-64793ffb6425', 'network_id': '31fa7821-6345-4f48-b070-9ceab6d12adf', 'port_id': '4a688d1f-1335-463f-b319-bcba153c442f', 'mac_address': 'fa:16:3e:dc:95:fe', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 59, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd10d11e6-b8a0-482d-9762-c8b3bdb048d3', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:57:37.672781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'device_id': '9e2086bf-7151-4c61-ae36-64793ffb6425', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'mac_address': 'fa:16:3e:d7:42:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.184'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:57:37.673602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '06b2816e-8529-43d4-82ae-6b0cacaeb5be', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-ca4cd8bc-b7e9-4c6f-bdc8-805e0843ee8e', 'network_id': 'ca4cd8bc-b7e9-4c6f-bdc8-805e0843ee8e', 'port_id': '06b2816e-8529-43d4-82ae-6b0cacaeb5be', 'mac_address': 'fa:16:3e:d8:28:e0', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 86, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '23b6c853-6aa6-4b19-9c76-ddde24e53ac3', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:57:37.678511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 4a688d1f-1335-463f-b319-bcba153c442f {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:57:37.679151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 4a688d1f-1335-463f-b319-bcba153c442f updated. Details: {'device': '4a688d1f-1335-463f-b319-bcba153c442f', 'device_id': '9e2086bf-7151-4c61-ae36-64793ffb6425', 'network_id': '31fa7821-6345-4f48-b070-9ceab6d12adf', 'port_id': '4a688d1f-1335-463f-b319-bcba153c442f', 'mac_address': 'fa:16:3e:dc:95:fe', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 59, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd10d11e6-b8a0-482d-9762-c8b3bdb048d3', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 8} Sep 25 00:57:37.681956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-4a688d1f-13, col_values=(('tag', 8),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:37.682780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-4a688d1f-13, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:37.684594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-4a688d1f-13, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:37.703406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-4a688d1f-13, col_values=(('other_config', {'net_uuid': '31fa7821-6345-4f48-b070-9ceab6d12adf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '8', 'segmentation_id': '59'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:37.713029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834df29,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 19}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:37.713480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: d2abc674-9be0-4d84-bba8-aeef142e4a64 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:57:37.713893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port d2abc674-9be0-4d84-bba8-aeef142e4a64 updated. Details: {'device': 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'device_id': '9e2086bf-7151-4c61-ae36-64793ffb6425', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'mac_address': 'fa:16:3e:d7:42:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.184'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 25 00:57:37.714921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-d2abc674-9b, col_values=(('tag', 2),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:37.715439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-d2abc674-9b, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:37.716761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-d2abc674-9b, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:37.717423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:57:37.719605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-d2abc674-9b, col_values=(('other_config', {'net_uuid': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:37.720980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:57:37.725976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834df2b,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 20}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:37.727023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 06b2816e-8529-43d4-82ae-6b0cacaeb5be {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:57:37.727568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 06b2816e-8529-43d4-82ae-6b0cacaeb5be updated. Details: {'device': '06b2816e-8529-43d4-82ae-6b0cacaeb5be', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-ca4cd8bc-b7e9-4c6f-bdc8-805e0843ee8e', 'network_id': 'ca4cd8bc-b7e9-4c6f-bdc8-805e0843ee8e', 'port_id': '06b2816e-8529-43d4-82ae-6b0cacaeb5be', 'mac_address': 'fa:16:3e:d8:28:e0', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 86, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '23b6c853-6aa6-4b19-9c76-ddde24e53ac3', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 25 00:57:37.728174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Assigning 9 as local vlan for net-id=ca4cd8bc-b7e9-4c6f-bdc8-805e0843ee8e, seg-id=86 Sep 25 00:57:37.733237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xa5d7ab48,OFPFlowMod(buffer_id=4294967295,command=0,cookie=13979250796582379444,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4182), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4105}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:37.739313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x7834df2d,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4105)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4182}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:37.740664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap06b2816e-85, col_values=(('tag', 9),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:37.742241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap06b2816e-85, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:37.742925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap06b2816e-85, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:37.751222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap06b2816e-85, col_values=(('other_config', {'net_uuid': 'ca4cd8bc-b7e9-4c6f-bdc8-805e0843ee8e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '9', 'segmentation_id': '86'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:37.772535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834df2f,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 21}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:37.773035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:303 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 17 devices currently available. Time elapsed: 0.103 Sep 25 00:57:37.773638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing device filters for 1 new devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 25 00:57:37.773888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing filters for devices {'06b2816e-8529-43d4-82ae-6b0cacaeb5be'} Sep 25 00:57:37.775906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:57:37.776619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:57:37.780816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:57:37.846010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e7711d-ab7e-4158-8ea0-6127b719ec87]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:57:37.846642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refreshing firewall for 2 devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 25 00:57:37.847004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refresh firewall rules Sep 25 00:57:37.849510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:57:37.849811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:57:37.859165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 4 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:57:37.925009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5b3fdb-08ea-4afb-a66e-c7260d313b71]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:57:37.926514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:303 - agent port security group processed in 0.256 Sep 25 00:57:37.927901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 4a688d1f-1335-463f-b319-bcba153c442f to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:57:37.928276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for d2abc674-9be0-4d84-bba8-aeef142e4a64 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:57:37.928894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 06b2816e-8529-43d4-82ae-6b0cacaeb5be to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:57:38.135681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ebc8cbbd-13c6-4a17-a017-7cccad127499 None None] Resource Port 4a688d1f-1335-463f-b319-bcba153c442f updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:57:38.137276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ebc8cbbd-13c6-4a17-a017-7cccad127499 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (4a688d1f-1335-463f-b319-bcba153c442f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:38.428088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9eba08b4-4202-4f8e-82b8-106258df21d9 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:57:37Z,data_plane_status=None,description='',device_id='6a441b6e-5258-48de-ac7a-ae9b0fcfa8c6',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=312a0875-9d08-4c94-b6f3-3135500afa6a,mac_address=fa:16:3e:e8:a4:64,name='',network_id=ca4cd8bc-b7e9-4c6f-bdc8-805e0843ee8e,numa_affinity_policy=,project_id='adf4f7abd15d45d1a06405bdb1e94eef',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(312a0875-9d08-4c94-b6f3-3135500afa6a),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:57:38Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:38.428605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9eba08b4-4202-4f8e-82b8-106258df21d9 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (312a0875-9d08-4c94-b6f3-3135500afa6a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:38.875614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9eba08b4-4202-4f8e-82b8-106258df21d9 admin admin] Received resource Port update without any changes: 312a0875-9d08-4c94-b6f3-3135500afa6a {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 25 00:57:39.058907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e779a87e-c49e-4a72-84b0-3727836f8d5a None None] Resource Port 06b2816e-8529-43d4-82ae-6b0cacaeb5be updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:57:39.059912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e779a87e-c49e-4a72-84b0-3727836f8d5a None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (06b2816e-8529-43d4-82ae-6b0cacaeb5be), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:39.213062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-eb5f6fca-f8a1-4d36-a034-999178b46f24 None None] Resource Port 783df414-cffa-4596-a921-2b930804680d updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=783df414-cffa-4596-a921-2b930804680d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=783df414-cffa-4596-a921-2b930804680d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:57:39.215636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-eb5f6fca-f8a1-4d36-a034-999178b46f24 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (783df414-cffa-4596-a921-2b930804680d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:39.275953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['4a688d1f-1335-463f-b319-bcba153c442f', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', '06b2816e-8529-43d4-82ae-6b0cacaeb5be'] and devices down [] completed. Sep 25 00:57:39.278633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:303 - ports processed. Elapsed:1.628 Sep 25 00:57:39.279365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:303 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 3, 'removed': 0}}. Elapsed:1.631 Sep 25 00:57:39.651682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:304 started Sep 25 00:57:39.666000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-eb5f6fca-f8a1-4d36-a034-999178b46f24 None None] Resource Port 783df414-cffa-4596-a921-2b930804680d updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=783df414-cffa-4596-a921-2b930804680d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=783df414-cffa-4596-a921-2b930804680d,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=783df414-cffa-4596-a921-2b930804680d,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:57:39.667075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-eb5f6fca-f8a1-4d36-a034-999178b46f24 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (783df414-cffa-4596-a921-2b930804680d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:39.673171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df31,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=396000000,duration_sec=622,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:39.675665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:57:39.677001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:304 - starting polling. Elapsed:0.025 Sep 25 00:57:39.694386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:39.703032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:304 - port information retrieved. Elapsed:0.052 Sep 25 00:57:39.703759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '68a3f405-e599-4339-b2a8-058311132e20', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', '7d521366-e68f-48bd-a7a8-e2283117a2b7', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '4a688d1f-1335-463f-b319-bcba153c442f', '1b8115fa-df9f-4b13-830a-866086f1b68f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'de4727a2-569d-44c6-a53e-ecc89817f610'}, 'added': set(), 'removed': set(), 'updated': {'4a688d1f-1335-463f-b319-bcba153c442f', '06b2816e-8529-43d4-82ae-6b0cacaeb5be'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:57:39.704551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '4a688d1f-1335-463f-b319-bcba153c442f', 'device_id': '9e2086bf-7151-4c61-ae36-64793ffb6425', 'network_id': '31fa7821-6345-4f48-b070-9ceab6d12adf', 'port_id': '4a688d1f-1335-463f-b319-bcba153c442f', 'mac_address': 'fa:16:3e:dc:95:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 59, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd10d11e6-b8a0-482d-9762-c8b3bdb048d3', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:57:39.708713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '06b2816e-8529-43d4-82ae-6b0cacaeb5be', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-ca4cd8bc-b7e9-4c6f-bdc8-805e0843ee8e', 'network_id': 'ca4cd8bc-b7e9-4c6f-bdc8-805e0843ee8e', 'port_id': '06b2816e-8529-43d4-82ae-6b0cacaeb5be', 'mac_address': 'fa:16:3e:d8:28:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 86, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '23b6c853-6aa6-4b19-9c76-ddde24e53ac3', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:57:39.713185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 4a688d1f-1335-463f-b319-bcba153c442f {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:57:39.713908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 4a688d1f-1335-463f-b319-bcba153c442f updated. Details: {'device': '4a688d1f-1335-463f-b319-bcba153c442f', 'device_id': '9e2086bf-7151-4c61-ae36-64793ffb6425', 'network_id': '31fa7821-6345-4f48-b070-9ceab6d12adf', 'port_id': '4a688d1f-1335-463f-b319-bcba153c442f', 'mac_address': 'fa:16:3e:dc:95:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 59, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd10d11e6-b8a0-482d-9762-c8b3bdb048d3', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 8} Sep 25 00:57:39.716459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-4a688d1f-13, col_values=(('tag', 8),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:39.717236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-4a688d1f-13, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:39.718051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-4a688d1f-13, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:39.719114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:57:39.721303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-4a688d1f-13, col_values=(('other_config', {'net_uuid': '31fa7821-6345-4f48-b070-9ceab6d12adf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '59', 'tag': '8'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:39.722502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:57:39.730117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834df33,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 19}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:39.731674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 06b2816e-8529-43d4-82ae-6b0cacaeb5be {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:57:39.732216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 06b2816e-8529-43d4-82ae-6b0cacaeb5be updated. Details: {'device': '06b2816e-8529-43d4-82ae-6b0cacaeb5be', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-ca4cd8bc-b7e9-4c6f-bdc8-805e0843ee8e', 'network_id': 'ca4cd8bc-b7e9-4c6f-bdc8-805e0843ee8e', 'port_id': '06b2816e-8529-43d4-82ae-6b0cacaeb5be', 'mac_address': 'fa:16:3e:d8:28:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 86, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '23b6c853-6aa6-4b19-9c76-ddde24e53ac3', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 9} Sep 25 00:57:39.733603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap06b2816e-85, col_values=(('tag', 9),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:39.734581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap06b2816e-85, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:39.735236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap06b2816e-85, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:39.735918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:57:39.752366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap06b2816e-85, col_values=(('other_config', {'net_uuid': 'ca4cd8bc-b7e9-4c6f-bdc8-805e0843ee8e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '86', 'tag': '9'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:39.755605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:57:39.768169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834df35,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 21}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:39.770588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:304 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 17 devices currently available. Time elapsed: 0.064 Sep 25 00:57:39.772177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refreshing firewall for 2 devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 25 00:57:39.773172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refresh firewall rules Sep 25 00:57:39.779385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:57:39.779989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:57:39.789686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 4 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:57:39.854463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7dcd2a-05f5-4cec-afd6-c1a01436deca]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:57:39.855337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:304 - agent port security group processed in 0.151 Sep 25 00:57:39.856772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 4a688d1f-1335-463f-b319-bcba153c442f to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:57:39.857672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 06b2816e-8529-43d4-82ae-6b0cacaeb5be to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:57:40.359539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b1d358ae-7980-4e73-9179-e19ba108c7c3 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:57:40Z,description='tempest-secgroup-smoke-1834758444 description',id=0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c,is_default=False,name='tempest-secgroup-smoke-1834758444',project_id='46f19fd9ad1e4880961d1eee75883687',revision_number=1,rules=[SecurityGroupRule(26526b29-166a-4837-b75d-1e91b867a485),SecurityGroupRule(e5eb6f91-37b3-4ff7-81e3-593481f25547)],shared=False,stateful=True,updated_at=2022-09-25T00:57:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:40.362283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b1d358ae-7980-4e73-9179-e19ba108c7c3 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:40.363758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b1d358ae-7980-4e73-9179-e19ba108c7c3 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:40Z,description=,direction='egress',ethertype='IPv4',id=26526b29-166a-4837-b75d-1e91b867a485,normalized_cidr=None,port_range_max=,port_range_min=,project_id='46f19fd9ad1e4880961d1eee75883687',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c,updated_at=2022-09-25T00:57:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:40.364501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b1d358ae-7980-4e73-9179-e19ba108c7c3 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (26526b29-166a-4837-b75d-1e91b867a485), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:40.364888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b1d358ae-7980-4e73-9179-e19ba108c7c3 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Security group rule updated ['0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c'] Sep 25 00:57:40.365863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b1d358ae-7980-4e73-9179-e19ba108c7c3 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:40Z,description=,direction='egress',ethertype='IPv6',id=e5eb6f91-37b3-4ff7-81e3-593481f25547,normalized_cidr=None,port_range_max=,port_range_min=,project_id='46f19fd9ad1e4880961d1eee75883687',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c,updated_at=2022-09-25T00:57:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:40.366231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b1d358ae-7980-4e73-9179-e19ba108c7c3 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (e5eb6f91-37b3-4ff7-81e3-593481f25547), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:40.367288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b1d358ae-7980-4e73-9179-e19ba108c7c3 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Security group rule updated ['0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c'] Sep 25 00:57:40.488649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8ce2b496-ef21-42ec-b4b9-a1b9f5660ad4","insert","qr-312a0875-9d",["set",[]],["map",[["attached-mac","fa:16:3e:e8:a4:64"],["iface-id","312a0875-9d08-4c94-b6f3-3135500afa6a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:57:40.502066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['4a688d1f-1335-463f-b319-bcba153c442f', '06b2816e-8529-43d4-82ae-6b0cacaeb5be'] and devices down [] completed. Sep 25 00:57:40.502066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:304 - ports processed. Elapsed:0.842 Sep 25 00:57:40.502066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:304 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 2, 'removed': 0}}. Elapsed:0.843 Sep 25 00:57:40.502066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8ce2b496-ef21-42ec-b4b9-a1b9f5660ad4","old",null,["set",[]],null],["","new","qr-312a0875-9d",22,["map",[["attached-mac","fa:16:3e:e8:a4:64"],["iface-id","312a0875-9d08-4c94-b6f3-3135500afa6a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:57:40.615280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-169f2c30-4211-4b61-a987-da75c5b1f92f tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:40Z,description='',direction='ingress',ethertype='IPv4',id=cad4d84d-14a0-4bbe-8e4f-db4708e1cc51,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='46f19fd9ad1e4880961d1eee75883687',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c,updated_at=2022-09-25T00:57:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:40.615978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-169f2c30-4211-4b61-a987-da75c5b1f92f tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (cad4d84d-14a0-4bbe-8e4f-db4708e1cc51), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:40.616419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-169f2c30-4211-4b61-a987-da75c5b1f92f tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Security group rule updated ['0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c'] Sep 25 00:57:40.746463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ead57a11-5381-422b-ba9f-ef3d0d40d0a8 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:40Z,description='',direction='egress',ethertype='IPv4',id=2e91c38f-123d-4c9b-a32e-0bdb9fecc811,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='46f19fd9ad1e4880961d1eee75883687',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c,updated_at=2022-09-25T00:57:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:40.747099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ead57a11-5381-422b-ba9f-ef3d0d40d0a8 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (2e91c38f-123d-4c9b-a32e-0bdb9fecc811), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:40.747965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ead57a11-5381-422b-ba9f-ef3d0d40d0a8 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Security group rule updated ['0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c'] Sep 25 00:57:40.879258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-dfcf9adf-d2be-4ef5-b02a-24a03b3c32c9 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:40Z,description='',direction='ingress',ethertype='IPv4',id=1a93d59a-3537-409f-9d48-42cfcfb66494,normalized_cidr=None,port_range_max=,port_range_min=,project_id='46f19fd9ad1e4880961d1eee75883687',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c,updated_at=2022-09-25T00:57:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:40.882759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-dfcf9adf-d2be-4ef5-b02a-24a03b3c32c9 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (1a93d59a-3537-409f-9d48-42cfcfb66494), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:40.882759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-dfcf9adf-d2be-4ef5-b02a-24a03b3c32c9 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Security group rule updated ['0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c'] Sep 25 00:57:40.948867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["fabe913c-51db-47a2-8aee-f8fb89e28f41","insert","qg-783df414-cf",["set",[]],["map",[["attached-mac","fa:16:3e:ab:c1:14"],["iface-id","783df414-cffa-4596-a921-2b930804680d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:57:40.969086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["fabe913c-51db-47a2-8aee-f8fb89e28f41","old",null,["set",[]],null],["","new","qg-783df414-cf",23,["map",[["attached-mac","fa:16:3e:ab:c1:14"],["iface-id","783df414-cffa-4596-a921-2b930804680d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:57:41.033878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2e95975a-3c65-447c-b511-4b444af05400 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:40Z,description='',direction='egress',ethertype='IPv4',id=98046b00-cf39-41a3-977b-863c5a3f5997,normalized_cidr=None,port_range_max=,port_range_min=,project_id='46f19fd9ad1e4880961d1eee75883687',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c,updated_at=2022-09-25T00:57:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:41.034582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2e95975a-3c65-447c-b511-4b444af05400 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (98046b00-cf39-41a3-977b-863c5a3f5997), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:41.037088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2e95975a-3c65-447c-b511-4b444af05400 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Security group rule updated ['0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c'] Sep 25 00:57:41.230649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-801bcf2c-d8b2-47ed-9a49-397692b84b39 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:41Z,description='',direction='ingress',ethertype='IPv6',id=847e03d8-ae41-4687-83aa-fea86ceaa734,normalized_cidr=None,port_range_max=,port_range_min=,project_id='46f19fd9ad1e4880961d1eee75883687',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c,updated_at=2022-09-25T00:57:41Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:41.231365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-801bcf2c-d8b2-47ed-9a49-397692b84b39 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (847e03d8-ae41-4687-83aa-fea86ceaa734), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:41.232375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-801bcf2c-d8b2-47ed-9a49-397692b84b39 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Security group rule updated ['0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c'] Sep 25 00:57:41.397939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a1451ad9-8820-4f4e-8a02-b97379566458 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:41Z,description='',direction='egress',ethertype='IPv6',id=7baef2f8-60d5-4771-9787-8d3bda636d64,normalized_cidr=None,port_range_max=,port_range_min=,project_id='46f19fd9ad1e4880961d1eee75883687',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c,updated_at=2022-09-25T00:57:41Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:57:41.399264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a1451ad9-8820-4f4e-8a02-b97379566458 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (7baef2f8-60d5-4771-9787-8d3bda636d64), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:41.399623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a1451ad9-8820-4f4e-8a02-b97379566458 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Security group rule updated ['0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c'] Sep 25 00:57:41.652477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:305 started Sep 25 00:57:41.656023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df37,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=381000000,duration_sec=624,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:41.656627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:57:41.657169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:305 - starting polling. Elapsed:0.005 Sep 25 00:57:41.659975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:41.664058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:305 - port information retrieved. Elapsed:0.012 Sep 25 00:57:41.664405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '68a3f405-e599-4339-b2a8-058311132e20', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', '7d521366-e68f-48bd-a7a8-e2283117a2b7', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', '312a0875-9d08-4c94-b6f3-3135500afa6a', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '4a688d1f-1335-463f-b319-bcba153c442f', '1b8115fa-df9f-4b13-830a-866086f1b68f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'de4727a2-569d-44c6-a53e-ecc89817f610'}, 'added': {'783df414-cffa-4596-a921-2b930804680d', '312a0875-9d08-4c94-b6f3-3135500afa6a'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:57:41.665021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '783df414-cffa-4596-a921-2b930804680d', 'device_id': '6a441b6e-5258-48de-ac7a-ae9b0fcfa8c6', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': '783df414-cffa-4596-a921-2b930804680d', 'mac_address': 'fa:16:3e:ab:c1:14', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.4'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:57:41.665700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: WARNING neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:57:37Z,data_plane_status=None,description='',device_id='6a441b6e-5258-48de-ac7a-ae9b0fcfa8c6',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=312a0875-9d08-4c94-b6f3-3135500afa6a,mac_address=fa:16:3e:e8:a4:64,name='',network_id=ca4cd8bc-b7e9-4c6f-bdc8-805e0843ee8e,numa_affinity_policy=,project_id='adf4f7abd15d45d1a06405bdb1e94eef',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(312a0875-9d08-4c94-b6f3-3135500afa6a),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:57:38Z) is not bound. Sep 25 00:57:41.669414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 783df414-cffa-4596-a921-2b930804680d {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:57:41.669757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 783df414-cffa-4596-a921-2b930804680d updated. Details: {'device': '783df414-cffa-4596-a921-2b930804680d', 'device_id': '6a441b6e-5258-48de-ac7a-ae9b0fcfa8c6', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': '783df414-cffa-4596-a921-2b930804680d', 'mac_address': 'fa:16:3e:ab:c1:14', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.4'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 25 00:57:41.670780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-783df414-cf, col_values=(('tag', 2),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:41.671216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-783df414-cf, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:41.671661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-783df414-cf, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:41.677601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-783df414-cf, col_values=(('other_config', {'net_uuid': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:41.690490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834df39,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 23}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:41.691711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 312a0875-9d08-4c94-b6f3-3135500afa6a {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:57:41.691985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Device 312a0875-9d08-4c94-b6f3-3135500afa6a not defined on plugin or binding failed Sep 25 00:57:41.692488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:305 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.028 Sep 25 00:57:41.692900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing device filters for 2 new devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 25 00:57:41.693125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing filters for devices {'783df414-cffa-4596-a921-2b930804680d', '312a0875-9d08-4c94-b6f3-3135500afa6a'} Sep 25 00:57:41.694718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:57:41.695012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:57:41.699778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:57:41.744698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2752e4-051c-4922-9221-704fba6dce30]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:57:41.745390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:305 - agent port security group processed in 0.081 Sep 25 00:57:41.746259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 783df414-cffa-4596-a921-2b930804680d to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:57:41.930247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['783df414-cffa-4596-a921-2b930804680d'] and devices down [] completed. Sep 25 00:57:41.930573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:305 - ports processed. Elapsed:0.278 Sep 25 00:57:41.930911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:305 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 0, 'removed': 0}}. Elapsed:0.279 Sep 25 00:57:41.993690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Resource Port 783df414-cffa-4596-a921-2b930804680d updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=783df414-cffa-4596-a921-2b930804680d,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=783df414-cffa-4596-a921-2b930804680d,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)], 'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:57:41.994128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (783df414-cffa-4596-a921-2b930804680d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:43.176638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5f24b040-1f80-4127-8ca3-35542b6ffd91 None None] Resource Port 312a0875-9d08-4c94-b6f3-3135500afa6a updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=312a0875-9d08-4c94-b6f3-3135500afa6a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=312a0875-9d08-4c94-b6f3-3135500afa6a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:57:43.177291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5f24b040-1f80-4127-8ca3-35542b6ffd91 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (312a0875-9d08-4c94-b6f3-3135500afa6a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:43.403430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5f24b040-1f80-4127-8ca3-35542b6ffd91 None None] Resource Port 312a0875-9d08-4c94-b6f3-3135500afa6a updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=312a0875-9d08-4c94-b6f3-3135500afa6a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=312a0875-9d08-4c94-b6f3-3135500afa6a,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=312a0875-9d08-4c94-b6f3-3135500afa6a,segment=NetworkSegment(ada409c8-3cbd-4590-9fd7-70e3397de373),segment_id=ada409c8-3cbd-4590-9fd7-70e3397de373)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:57:43.403922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5f24b040-1f80-4127-8ca3-35542b6ffd91 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (312a0875-9d08-4c94-b6f3-3135500afa6a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:43.653034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:306 started Sep 25 00:57:43.655891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df3b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=382000000,duration_sec=626,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:43.656461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:57:43.656802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:306 - starting polling. Elapsed:0.004 Sep 25 00:57:43.659402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:43.663787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:306 - port information retrieved. Elapsed:0.011 Sep 25 00:57:43.664136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '68a3f405-e599-4339-b2a8-058311132e20', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', '7d521366-e68f-48bd-a7a8-e2283117a2b7', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', '312a0875-9d08-4c94-b6f3-3135500afa6a', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '4a688d1f-1335-463f-b319-bcba153c442f', '1b8115fa-df9f-4b13-830a-866086f1b68f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'de4727a2-569d-44c6-a53e-ecc89817f610'}, 'added': set(), 'removed': set(), 'updated': {'783df414-cffa-4596-a921-2b930804680d', '312a0875-9d08-4c94-b6f3-3135500afa6a'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:57:43.665117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '783df414-cffa-4596-a921-2b930804680d', 'device_id': '6a441b6e-5258-48de-ac7a-ae9b0fcfa8c6', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': '783df414-cffa-4596-a921-2b930804680d', 'mac_address': 'fa:16:3e:ab:c1:14', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.4'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:57:43.665770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '312a0875-9d08-4c94-b6f3-3135500afa6a', 'device_id': '6a441b6e-5258-48de-ac7a-ae9b0fcfa8c6', 'network_id': 'ca4cd8bc-b7e9-4c6f-bdc8-805e0843ee8e', 'port_id': '312a0875-9d08-4c94-b6f3-3135500afa6a', 'mac_address': 'fa:16:3e:e8:a4:64', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 86, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '23b6c853-6aa6-4b19-9c76-ddde24e53ac3', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:57:43.669197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 783df414-cffa-4596-a921-2b930804680d {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:57:43.669542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 783df414-cffa-4596-a921-2b930804680d updated. Details: {'device': '783df414-cffa-4596-a921-2b930804680d', 'device_id': '6a441b6e-5258-48de-ac7a-ae9b0fcfa8c6', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': '783df414-cffa-4596-a921-2b930804680d', 'mac_address': 'fa:16:3e:ab:c1:14', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.4'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 25 00:57:43.670917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-783df414-cf, col_values=(('tag', 2),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:43.671173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-783df414-cf, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:43.671736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-783df414-cf, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:43.672181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:57:43.673387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-783df414-cf, col_values=(('other_config', {'net_uuid': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:43.674037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:57:43.678177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834df3d,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 23}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:43.678537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 312a0875-9d08-4c94-b6f3-3135500afa6a {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:57:43.678861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 312a0875-9d08-4c94-b6f3-3135500afa6a updated. Details: {'device': '312a0875-9d08-4c94-b6f3-3135500afa6a', 'device_id': '6a441b6e-5258-48de-ac7a-ae9b0fcfa8c6', 'network_id': 'ca4cd8bc-b7e9-4c6f-bdc8-805e0843ee8e', 'port_id': '312a0875-9d08-4c94-b6f3-3135500afa6a', 'mac_address': 'fa:16:3e:e8:a4:64', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 86, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '23b6c853-6aa6-4b19-9c76-ddde24e53ac3', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 9} Sep 25 00:57:43.679986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-312a0875-9d, col_values=(('tag', 9),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:43.680414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-312a0875-9d, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:43.680845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-312a0875-9d, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:43.689751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-312a0875-9d, col_values=(('other_config', {'net_uuid': 'ca4cd8bc-b7e9-4c6f-bdc8-805e0843ee8e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '9', 'segmentation_id': '86'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:43.702660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834df3f,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 22}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:43.703591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:306 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.039 Sep 25 00:57:43.704136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refreshing firewall for 2 devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 25 00:57:43.704605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refresh firewall rules Sep 25 00:57:43.707811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:57:43.708165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:57:43.713332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 4 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:57:43.773038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82862e2-7578-4765-bf6f-9b56dd593fab]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:57:43.774300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:306 - agent port security group processed in 0.110 Sep 25 00:57:43.775185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 783df414-cffa-4596-a921-2b930804680d to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:57:43.775480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 312a0875-9d08-4c94-b6f3-3135500afa6a to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:57:44.020229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-28fc08a0-d7a7-4e35-85f9-8d64ccb7ae46 None None] Resource Port 312a0875-9d08-4c94-b6f3-3135500afa6a updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:57:44.021326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-28fc08a0-d7a7-4e35-85f9-8d64ccb7ae46 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (312a0875-9d08-4c94-b6f3-3135500afa6a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:44.243539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['783df414-cffa-4596-a921-2b930804680d', '312a0875-9d08-4c94-b6f3-3135500afa6a'] and devices down [] completed. Sep 25 00:57:44.244628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:306 - ports processed. Elapsed:0.592 Sep 25 00:57:44.244970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:306 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 2, 'removed': 0}}. Elapsed:0.592 Sep 25 00:57:45.654467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:307 started Sep 25 00:57:45.658007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df41,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=384000000,duration_sec=628,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:45.658858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:57:45.659208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:307 - starting polling. Elapsed:0.005 Sep 25 00:57:45.663036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:57:45.667160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:307 - port information retrieved. Elapsed:0.013 Sep 25 00:57:45.667523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '68a3f405-e599-4339-b2a8-058311132e20', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', '7d521366-e68f-48bd-a7a8-e2283117a2b7', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', '312a0875-9d08-4c94-b6f3-3135500afa6a', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '4a688d1f-1335-463f-b319-bcba153c442f', '1b8115fa-df9f-4b13-830a-866086f1b68f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'de4727a2-569d-44c6-a53e-ecc89817f610'}, 'added': set(), 'removed': set(), 'updated': {'312a0875-9d08-4c94-b6f3-3135500afa6a'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:57:45.668104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '312a0875-9d08-4c94-b6f3-3135500afa6a', 'device_id': '6a441b6e-5258-48de-ac7a-ae9b0fcfa8c6', 'network_id': 'ca4cd8bc-b7e9-4c6f-bdc8-805e0843ee8e', 'port_id': '312a0875-9d08-4c94-b6f3-3135500afa6a', 'mac_address': 'fa:16:3e:e8:a4:64', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 86, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '23b6c853-6aa6-4b19-9c76-ddde24e53ac3', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:57:45.671573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 312a0875-9d08-4c94-b6f3-3135500afa6a {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:57:45.671899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 312a0875-9d08-4c94-b6f3-3135500afa6a updated. Details: {'device': '312a0875-9d08-4c94-b6f3-3135500afa6a', 'device_id': '6a441b6e-5258-48de-ac7a-ae9b0fcfa8c6', 'network_id': 'ca4cd8bc-b7e9-4c6f-bdc8-805e0843ee8e', 'port_id': '312a0875-9d08-4c94-b6f3-3135500afa6a', 'mac_address': 'fa:16:3e:e8:a4:64', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 86, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '23b6c853-6aa6-4b19-9c76-ddde24e53ac3', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 9} Sep 25 00:57:45.673001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-312a0875-9d, col_values=(('tag', 9),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:45.673642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-312a0875-9d, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:45.674051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-312a0875-9d, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:45.674513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:57:45.675943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-312a0875-9d, col_values=(('other_config', {'net_uuid': 'ca4cd8bc-b7e9-4c6f-bdc8-805e0843ee8e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '86', 'tag': '9'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:57:45.677094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:57:45.679424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834df43,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 22}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:45.679792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:307 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.012 Sep 25 00:57:45.680140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refreshing firewall for 1 devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 25 00:57:45.680424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refresh firewall rules Sep 25 00:57:45.681600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:57:45.681889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:57:45.686507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:57:45.738825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bf8be9-cb9f-4525-aa6a-52af06707016]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:57:45.739445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:307 - agent port security group processed in 0.072 Sep 25 00:57:45.740327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 312a0875-9d08-4c94-b6f3-3135500afa6a to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:57:45.871060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['312a0875-9d08-4c94-b6f3-3135500afa6a'] and devices down [] completed. Sep 25 00:57:45.871384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:307 - ports processed. Elapsed:0.217 Sep 25 00:57:45.871727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:307 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.217 Sep 25 00:57:47.655955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:308 started Sep 25 00:57:47.658452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df45,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=384000000,duration_sec=630,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:47.659030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:57:47.659389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:308 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:57:49.657602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:309 started Sep 25 00:57:49.660268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df47,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=386000000,duration_sec=632,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:49.660928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:57:49.661302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:309 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:57:51.658755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:310 started Sep 25 00:57:51.663765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df49,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=387000000,duration_sec=634,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:51.664978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:57:51.665904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:310 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 00:57:53.660951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:311 started Sep 25 00:57:53.663428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df4b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=389000000,duration_sec=636,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:53.663994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:57:53.664344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:311 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:57:55.661655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:312 started Sep 25 00:57:55.664304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df4d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=390000000,duration_sec=638,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:55.664873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:57:55.665224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:312 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:57:57.662737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:313 started Sep 25 00:57:57.665172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df4f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=391000000,duration_sec=640,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:57.666286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:57:57.666286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:313 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:57:59.663972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:314 started Sep 25 00:57:59.666878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df51,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=393000000,duration_sec=642,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:57:59.667549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:57:59.667910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:314 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:58:00.128180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f066eb2b-ee4a-4969-9963-7a87c3ab70eb admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:57:59Z,description='Default security group',id=b0b278e6-091d-4827-9756-897349cec9a0,is_default=True,name='default',project_id='7750b9ec659c40a1aafc98b0107032c5',revision_number=1,rules=[SecurityGroupRule(3f825556-b13b-4669-b7ed-d93ca27fad4a),SecurityGroupRule(639c116b-b0e6-4e1c-b17e-fe777ded688c),SecurityGroupRule(73c46b1e-39fb-4a42-b685-9cd3e1de482e),SecurityGroupRule(b65fb4b8-5295-40ad-afa1-2c3e07a9a96f)],shared=False,stateful=True,updated_at=2022-09-25T00:57:59Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:00.128661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f066eb2b-ee4a-4969-9963-7a87c3ab70eb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (b0b278e6-091d-4827-9756-897349cec9a0), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:00.129557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f066eb2b-ee4a-4969-9963-7a87c3ab70eb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:00Z,description=,direction='egress',ethertype='IPv4',id=3f825556-b13b-4669-b7ed-d93ca27fad4a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7750b9ec659c40a1aafc98b0107032c5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b0b278e6-091d-4827-9756-897349cec9a0,updated_at=2022-09-25T00:58:00Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:00.129924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f066eb2b-ee4a-4969-9963-7a87c3ab70eb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (3f825556-b13b-4669-b7ed-d93ca27fad4a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:00.130258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f066eb2b-ee4a-4969-9963-7a87c3ab70eb admin admin] Security group rule updated ['b0b278e6-091d-4827-9756-897349cec9a0'] Sep 25 00:58:00.130936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f066eb2b-ee4a-4969-9963-7a87c3ab70eb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:57:59Z,description=,direction='ingress',ethertype='IPv4',id=639c116b-b0e6-4e1c-b17e-fe777ded688c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7750b9ec659c40a1aafc98b0107032c5',protocol=,remote_address_group_id=,remote_group_id=b0b278e6-091d-4827-9756-897349cec9a0,remote_ip_prefix=,revision_number=0,security_group_id=b0b278e6-091d-4827-9756-897349cec9a0,updated_at=2022-09-25T00:57:59Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:00.131289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f066eb2b-ee4a-4969-9963-7a87c3ab70eb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (639c116b-b0e6-4e1c-b17e-fe777ded688c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:00.131610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f066eb2b-ee4a-4969-9963-7a87c3ab70eb admin admin] Security group rule updated ['b0b278e6-091d-4827-9756-897349cec9a0'] Sep 25 00:58:00.132428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f066eb2b-ee4a-4969-9963-7a87c3ab70eb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:00Z,description=,direction='ingress',ethertype='IPv6',id=73c46b1e-39fb-4a42-b685-9cd3e1de482e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7750b9ec659c40a1aafc98b0107032c5',protocol=,remote_address_group_id=,remote_group_id=b0b278e6-091d-4827-9756-897349cec9a0,remote_ip_prefix=,revision_number=0,security_group_id=b0b278e6-091d-4827-9756-897349cec9a0,updated_at=2022-09-25T00:58:00Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:00.132781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f066eb2b-ee4a-4969-9963-7a87c3ab70eb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (73c46b1e-39fb-4a42-b685-9cd3e1de482e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:00.133272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f066eb2b-ee4a-4969-9963-7a87c3ab70eb admin admin] Security group rule updated ['b0b278e6-091d-4827-9756-897349cec9a0'] Sep 25 00:58:00.133923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f066eb2b-ee4a-4969-9963-7a87c3ab70eb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:00Z,description=,direction='egress',ethertype='IPv6',id=b65fb4b8-5295-40ad-afa1-2c3e07a9a96f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7750b9ec659c40a1aafc98b0107032c5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b0b278e6-091d-4827-9756-897349cec9a0,updated_at=2022-09-25T00:58:00Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:00.134473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f066eb2b-ee4a-4969-9963-7a87c3ab70eb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (b65fb4b8-5295-40ad-afa1-2c3e07a9a96f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:00.134992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f066eb2b-ee4a-4969-9963-7a87c3ab70eb admin admin] Security group rule updated ['b0b278e6-091d-4827-9756-897349cec9a0'] Sep 25 00:58:00.249514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8d607e91-e5a5-48f8-864e-dcf3d9e3eb73 admin admin] Resource SecurityGroup deleted: b0b278e6-091d-4827-9756-897349cec9a0 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:00.249891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8d607e91-e5a5-48f8-864e-dcf3d9e3eb73 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (b0b278e6-091d-4827-9756-897349cec9a0), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:00.250354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d607e91-e5a5-48f8-864e-dcf3d9e3eb73 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('b0b278e6-091d-4827-9756-897349cec9a0',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:58:00.271341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8d607e91-e5a5-48f8-864e-dcf3d9e3eb73 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('b0b278e6-091d-4827-9756-897349cec9a0',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:58:00.271919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8d607e91-e5a5-48f8-864e-dcf3d9e3eb73 admin admin] Resource SecurityGroupRule deleted: 3f825556-b13b-4669-b7ed-d93ca27fad4a {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:00.272426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8d607e91-e5a5-48f8-864e-dcf3d9e3eb73 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (3f825556-b13b-4669-b7ed-d93ca27fad4a), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:00.272826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8d607e91-e5a5-48f8-864e-dcf3d9e3eb73 admin admin] Security group rule updated ['b0b278e6-091d-4827-9756-897349cec9a0'] Sep 25 00:58:00.273381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8d607e91-e5a5-48f8-864e-dcf3d9e3eb73 admin admin] Resource SecurityGroupRule deleted: 639c116b-b0e6-4e1c-b17e-fe777ded688c {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:00.273804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8d607e91-e5a5-48f8-864e-dcf3d9e3eb73 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (639c116b-b0e6-4e1c-b17e-fe777ded688c), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:00.274344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8d607e91-e5a5-48f8-864e-dcf3d9e3eb73 admin admin] Security group rule updated ['b0b278e6-091d-4827-9756-897349cec9a0'] Sep 25 00:58:00.275248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8d607e91-e5a5-48f8-864e-dcf3d9e3eb73 admin admin] Resource SecurityGroupRule deleted: 73c46b1e-39fb-4a42-b685-9cd3e1de482e {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:00.275674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8d607e91-e5a5-48f8-864e-dcf3d9e3eb73 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (73c46b1e-39fb-4a42-b685-9cd3e1de482e), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:00.276067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8d607e91-e5a5-48f8-864e-dcf3d9e3eb73 admin admin] Security group rule updated ['b0b278e6-091d-4827-9756-897349cec9a0'] Sep 25 00:58:00.276911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8d607e91-e5a5-48f8-864e-dcf3d9e3eb73 admin admin] Resource SecurityGroupRule deleted: b65fb4b8-5295-40ad-afa1-2c3e07a9a96f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:00.277586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8d607e91-e5a5-48f8-864e-dcf3d9e3eb73 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (b65fb4b8-5295-40ad-afa1-2c3e07a9a96f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:00.277983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8d607e91-e5a5-48f8-864e-dcf3d9e3eb73 admin admin] Security group rule updated ['b0b278e6-091d-4827-9756-897349cec9a0'] Sep 25 00:58:01.362114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a77c7433-4821-4638-9cd0-4f2403d6bf1e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:58:01Z,description='Default security group',id=47fc2ceb-5981-4459-96bb-0733dbea7206,is_default=True,name='default',project_id='4e348390b8774830a7542bb983bd5672',revision_number=1,rules=[SecurityGroupRule(07ff569e-e856-4697-83b1-fff980c79d27),SecurityGroupRule(62e0ba6d-a073-41bc-86a6-2c322a50a1bf),SecurityGroupRule(7c644845-b8b4-424b-a671-6e91bffc67b9),SecurityGroupRule(fd0c6b04-32f0-424c-bb7a-f01c2394f7e9)],shared=False,stateful=True,updated_at=2022-09-25T00:58:01Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:01.363781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a77c7433-4821-4638-9cd0-4f2403d6bf1e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (47fc2ceb-5981-4459-96bb-0733dbea7206), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:01.364495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a77c7433-4821-4638-9cd0-4f2403d6bf1e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:01Z,description=,direction='egress',ethertype='IPv4',id=07ff569e-e856-4697-83b1-fff980c79d27,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4e348390b8774830a7542bb983bd5672',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=47fc2ceb-5981-4459-96bb-0733dbea7206,updated_at=2022-09-25T00:58:01Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:01.364872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a77c7433-4821-4638-9cd0-4f2403d6bf1e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (07ff569e-e856-4697-83b1-fff980c79d27), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:01.365211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a77c7433-4821-4638-9cd0-4f2403d6bf1e admin admin] Security group rule updated ['47fc2ceb-5981-4459-96bb-0733dbea7206'] Sep 25 00:58:01.366564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a77c7433-4821-4638-9cd0-4f2403d6bf1e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:01Z,description=,direction='ingress',ethertype='IPv6',id=62e0ba6d-a073-41bc-86a6-2c322a50a1bf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4e348390b8774830a7542bb983bd5672',protocol=,remote_address_group_id=,remote_group_id=47fc2ceb-5981-4459-96bb-0733dbea7206,remote_ip_prefix=,revision_number=0,security_group_id=47fc2ceb-5981-4459-96bb-0733dbea7206,updated_at=2022-09-25T00:58:01Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:01.366982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a77c7433-4821-4638-9cd0-4f2403d6bf1e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (62e0ba6d-a073-41bc-86a6-2c322a50a1bf), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:01.367698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a77c7433-4821-4638-9cd0-4f2403d6bf1e admin admin] Security group rule updated ['47fc2ceb-5981-4459-96bb-0733dbea7206'] Sep 25 00:58:01.368494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a77c7433-4821-4638-9cd0-4f2403d6bf1e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:01Z,description=,direction='ingress',ethertype='IPv4',id=7c644845-b8b4-424b-a671-6e91bffc67b9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4e348390b8774830a7542bb983bd5672',protocol=,remote_address_group_id=,remote_group_id=47fc2ceb-5981-4459-96bb-0733dbea7206,remote_ip_prefix=,revision_number=0,security_group_id=47fc2ceb-5981-4459-96bb-0733dbea7206,updated_at=2022-09-25T00:58:01Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:01.370233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a77c7433-4821-4638-9cd0-4f2403d6bf1e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (7c644845-b8b4-424b-a671-6e91bffc67b9), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:01.370759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a77c7433-4821-4638-9cd0-4f2403d6bf1e admin admin] Security group rule updated ['47fc2ceb-5981-4459-96bb-0733dbea7206'] Sep 25 00:58:01.371597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a77c7433-4821-4638-9cd0-4f2403d6bf1e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:01Z,description=,direction='egress',ethertype='IPv6',id=fd0c6b04-32f0-424c-bb7a-f01c2394f7e9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4e348390b8774830a7542bb983bd5672',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=47fc2ceb-5981-4459-96bb-0733dbea7206,updated_at=2022-09-25T00:58:01Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:01.372170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a77c7433-4821-4638-9cd0-4f2403d6bf1e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (fd0c6b04-32f0-424c-bb7a-f01c2394f7e9), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:01.372656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a77c7433-4821-4638-9cd0-4f2403d6bf1e admin admin] Security group rule updated ['47fc2ceb-5981-4459-96bb-0733dbea7206'] Sep 25 00:58:01.532453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-46674f59-1c1f-47cf-af7c-71dfd9c4bcbd admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:58:01Z,description='Default security group',id=5820ec3a-8d2a-47c6-8b82-59a1dad211f3,is_default=True,name='default',project_id='b161c2e2dd1f42159dc0d71e8216516c',revision_number=1,rules=[SecurityGroupRule(059112b5-450d-43f3-848e-b7b4da7d4cea),SecurityGroupRule(3b858c90-b191-428f-a0a4-edc3a086c93f),SecurityGroupRule(55fe58a3-7f50-4faa-b963-1734306ed895),SecurityGroupRule(5ef38116-5cc8-4f99-8063-b5b21bbfb3f1)],shared=False,stateful=True,updated_at=2022-09-25T00:58:01Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:01.532924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-46674f59-1c1f-47cf-af7c-71dfd9c4bcbd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (5820ec3a-8d2a-47c6-8b82-59a1dad211f3), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:01.533711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-46674f59-1c1f-47cf-af7c-71dfd9c4bcbd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:01Z,description=,direction='egress',ethertype='IPv6',id=059112b5-450d-43f3-848e-b7b4da7d4cea,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b161c2e2dd1f42159dc0d71e8216516c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5820ec3a-8d2a-47c6-8b82-59a1dad211f3,updated_at=2022-09-25T00:58:01Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:01.535180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-46674f59-1c1f-47cf-af7c-71dfd9c4bcbd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (059112b5-450d-43f3-848e-b7b4da7d4cea), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:01.535445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-46674f59-1c1f-47cf-af7c-71dfd9c4bcbd admin admin] Security group rule updated ['5820ec3a-8d2a-47c6-8b82-59a1dad211f3'] Sep 25 00:58:01.536264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-46674f59-1c1f-47cf-af7c-71dfd9c4bcbd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:01Z,description=,direction='egress',ethertype='IPv4',id=3b858c90-b191-428f-a0a4-edc3a086c93f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b161c2e2dd1f42159dc0d71e8216516c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5820ec3a-8d2a-47c6-8b82-59a1dad211f3,updated_at=2022-09-25T00:58:01Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:01.536705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-46674f59-1c1f-47cf-af7c-71dfd9c4bcbd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (3b858c90-b191-428f-a0a4-edc3a086c93f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:01.537236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-46674f59-1c1f-47cf-af7c-71dfd9c4bcbd admin admin] Security group rule updated ['5820ec3a-8d2a-47c6-8b82-59a1dad211f3'] Sep 25 00:58:01.538523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-46674f59-1c1f-47cf-af7c-71dfd9c4bcbd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:01Z,description=,direction='ingress',ethertype='IPv4',id=55fe58a3-7f50-4faa-b963-1734306ed895,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b161c2e2dd1f42159dc0d71e8216516c',protocol=,remote_address_group_id=,remote_group_id=5820ec3a-8d2a-47c6-8b82-59a1dad211f3,remote_ip_prefix=,revision_number=0,security_group_id=5820ec3a-8d2a-47c6-8b82-59a1dad211f3,updated_at=2022-09-25T00:58:01Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:01.539228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-46674f59-1c1f-47cf-af7c-71dfd9c4bcbd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (55fe58a3-7f50-4faa-b963-1734306ed895), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:01.539774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-46674f59-1c1f-47cf-af7c-71dfd9c4bcbd admin admin] Security group rule updated ['5820ec3a-8d2a-47c6-8b82-59a1dad211f3'] Sep 25 00:58:01.540732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-46674f59-1c1f-47cf-af7c-71dfd9c4bcbd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:01Z,description=,direction='ingress',ethertype='IPv6',id=5ef38116-5cc8-4f99-8063-b5b21bbfb3f1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b161c2e2dd1f42159dc0d71e8216516c',protocol=,remote_address_group_id=,remote_group_id=5820ec3a-8d2a-47c6-8b82-59a1dad211f3,remote_ip_prefix=,revision_number=0,security_group_id=5820ec3a-8d2a-47c6-8b82-59a1dad211f3,updated_at=2022-09-25T00:58:01Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:01.541687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-46674f59-1c1f-47cf-af7c-71dfd9c4bcbd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (5ef38116-5cc8-4f99-8063-b5b21bbfb3f1), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:01.542290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-46674f59-1c1f-47cf-af7c-71dfd9c4bcbd admin admin] Security group rule updated ['5820ec3a-8d2a-47c6-8b82-59a1dad211f3'] Sep 25 00:58:01.614027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-84aa0773-262a-4761-917a-1969a13b2a3a admin admin] Resource SecurityGroup deleted: 47fc2ceb-5981-4459-96bb-0733dbea7206 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:01.614466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-84aa0773-262a-4761-917a-1969a13b2a3a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (47fc2ceb-5981-4459-96bb-0733dbea7206), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:01.614937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84aa0773-262a-4761-917a-1969a13b2a3a admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('47fc2ceb-5981-4459-96bb-0733dbea7206',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:58:01.630986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-84aa0773-262a-4761-917a-1969a13b2a3a admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('47fc2ceb-5981-4459-96bb-0733dbea7206',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:58:01.631836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-84aa0773-262a-4761-917a-1969a13b2a3a admin admin] Resource SecurityGroupRule deleted: 07ff569e-e856-4697-83b1-fff980c79d27 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:01.632462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-84aa0773-262a-4761-917a-1969a13b2a3a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (07ff569e-e856-4697-83b1-fff980c79d27), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:01.632950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-84aa0773-262a-4761-917a-1969a13b2a3a admin admin] Security group rule updated ['47fc2ceb-5981-4459-96bb-0733dbea7206'] Sep 25 00:58:01.633539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-84aa0773-262a-4761-917a-1969a13b2a3a admin admin] Resource SecurityGroupRule deleted: 62e0ba6d-a073-41bc-86a6-2c322a50a1bf {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:01.634036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-84aa0773-262a-4761-917a-1969a13b2a3a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (62e0ba6d-a073-41bc-86a6-2c322a50a1bf), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:01.634508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-84aa0773-262a-4761-917a-1969a13b2a3a admin admin] Security group rule updated ['47fc2ceb-5981-4459-96bb-0733dbea7206'] Sep 25 00:58:01.634886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-84aa0773-262a-4761-917a-1969a13b2a3a admin admin] Resource SecurityGroupRule deleted: 7c644845-b8b4-424b-a671-6e91bffc67b9 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:01.635236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-84aa0773-262a-4761-917a-1969a13b2a3a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (7c644845-b8b4-424b-a671-6e91bffc67b9), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:01.635557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-84aa0773-262a-4761-917a-1969a13b2a3a admin admin] Security group rule updated ['47fc2ceb-5981-4459-96bb-0733dbea7206'] Sep 25 00:58:01.636070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-84aa0773-262a-4761-917a-1969a13b2a3a admin admin] Resource SecurityGroupRule deleted: fd0c6b04-32f0-424c-bb7a-f01c2394f7e9 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:01.636478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-84aa0773-262a-4761-917a-1969a13b2a3a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (fd0c6b04-32f0-424c-bb7a-f01c2394f7e9), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:01.636813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-84aa0773-262a-4761-917a-1969a13b2a3a admin admin] Security group rule updated ['47fc2ceb-5981-4459-96bb-0733dbea7206'] Sep 25 00:58:01.665316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:315 started Sep 25 00:58:01.669857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df53,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=395000000,duration_sec=644,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:01.671129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:58:01.671826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:315 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 00:58:01.712974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-46674f59-1c1f-47cf-af7c-71dfd9c4bcbd admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-25T00:58:01Z,description='',dns_domain=None,id=f9e440d6-f48e-45bb-9a01-3ccd9ccf9488,mtu=1500,name='tempest-TestMinimumBasicScenario-2101028878-network',project_id='b161c2e2dd1f42159dc0d71e8216516c',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(f9e440d6-f48e-45bb-9a01-3ccd9ccf9488),segments=[NetworkSegment(d3b4c62f-808e-4358-bc7d-2cd03571d715)],shared=False,status='ACTIVE',updated_at=2022-09-25T00:58:01Z,vlan_transparent=) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:01.713395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-46674f59-1c1f-47cf-af7c-71dfd9c4bcbd admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (f9e440d6-f48e-45bb-9a01-3ccd9ccf9488), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:01.799909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager [None req-46674f59-1c1f-47cf-af7c-71dfd9c4bcbd admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network f9e440d6-f48e-45bb-9a01-3ccd9ccf9488 with segmentation id not found. Sep 25 00:58:01.799909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 25 00:58:01.799909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 25 00:58:01.799909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 25 00:58:01.799909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 25 00:58:01.799909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 25 00:58:01.799909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 25 00:58:01.799909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 25 00:58:01.799909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 25 00:58:01.799909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 25 00:58:01.799909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 25 00:58:01.799909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 25 00:58:01.799909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 25 00:58:01.801164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 25 00:58:01.801164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 25 00:58:01.801164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 25 00:58:01.801164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network f9e440d6-f48e-45bb-9a01-3ccd9ccf9488 with segmentation id not found. Sep 25 00:58:01.801164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Sep 25 00:58:02.018107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-646b31e9-7cc5-4ac3-877d-07a36b9e4e13 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(bd0cd3ea-bedd-4471-bffa-7f7eba968219)],cidr=172.20.0.0/28,created_at=2022-09-25T00:58:01Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=d74e111d-e663-49eb-9c15-00f7b719c28d,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestMinimumBasicScenario-2101028878-subnet',network_id=f9e440d6-f48e-45bb-9a01-3ccd9ccf9488,project_id='b161c2e2dd1f42159dc0d71e8216516c',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-25T00:58:01Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:02.018770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-646b31e9-7cc5-4ac3-877d-07a36b9e4e13 admin admin] Publish callbacks [] for Subnet (d74e111d-e663-49eb-9c15-00f7b719c28d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:02.942892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0f2e4cae-3a4f-4c2c-97bf-98be5ed331ac None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:58:02Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-f9e440d6-f48e-45bb-9a01-3ccd9ccf9488',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=078c0e3b-64fa-4b32-9903-3d2ac504d9d4,mac_address=fa:16:3e:51:25:e5,name='',network_id=f9e440d6-f48e-45bb-9a01-3ccd9ccf9488,numa_affinity_policy=,project_id='b161c2e2dd1f42159dc0d71e8216516c',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(078c0e3b-64fa-4b32-9903-3d2ac504d9d4),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:58:02Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:02.944152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0f2e4cae-3a4f-4c2c-97bf-98be5ed331ac None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (078c0e3b-64fa-4b32-9903-3d2ac504d9d4), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:03.234222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0f2e4cae-3a4f-4c2c-97bf-98be5ed331ac None None] Resource Port 078c0e3b-64fa-4b32-9903-3d2ac504d9d4 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=078c0e3b-64fa-4b32-9903-3d2ac504d9d4,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=078c0e3b-64fa-4b32-9903-3d2ac504d9d4,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=078c0e3b-64fa-4b32-9903-3d2ac504d9d4,segment=NetworkSegment(d3b4c62f-808e-4358-bc7d-2cd03571d715),segment_id=d3b4c62f-808e-4358-bc7d-2cd03571d715)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:03.234609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0f2e4cae-3a4f-4c2c-97bf-98be5ed331ac None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (078c0e3b-64fa-4b32-9903-3d2ac504d9d4), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:03.388252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["b57fb6cd-b0e7-4310-b1e9-58252d0b3e12","insert","tap078c0e3b-64",["set",[]],["map",[["attached-mac","fa:16:3e:51:25:e5"],["iface-id","078c0e3b-64fa-4b32-9903-3d2ac504d9d4"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:58:03.424721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["b57fb6cd-b0e7-4310-b1e9-58252d0b3e12","old",null,["set",[]],null],["","new","tap078c0e3b-64",24,["map",[["attached-mac","fa:16:3e:51:25:e5"],["iface-id","078c0e3b-64fa-4b32-9903-3d2ac504d9d4"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:58:03.443870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f2b37454-d995-45bd-87da-55ac66a7d39f admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:58:03Z,data_plane_status=None,description='',device_id='95fe8ae6-34dd-49d1-84c4-0403b5fc0d07',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=c41e83db-31a6-4fd6-a328-2ef3b504c9c3,mac_address=fa:16:3e:b4:23:a7,name='',network_id=62195cd6-54fa-4e24-9d47-ae0de6356ac2,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(c41e83db-31a6-4fd6-a328-2ef3b504c9c3),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:58:03Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:03.444403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f2b37454-d995-45bd-87da-55ac66a7d39f admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (c41e83db-31a6-4fd6-a328-2ef3b504c9c3), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:03.559645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-02a29172-57d7-481d-bf69-06efce6a47c3 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:58:03Z,description='Default security group',id=862e1068-1716-4ff0-8d9b-cc559f4ca0fd,is_default=True,name='default',project_id='d5f8f084099d4b37b67aba3cda9ecff3',revision_number=1,rules=[SecurityGroupRule(05cf06a9-c1f9-4a2e-a5c3-b7b6da0f91cd),SecurityGroupRule(73ffede5-748c-4d3e-8480-75c237bc39cb),SecurityGroupRule(8d05f554-52bd-41fb-8157-b67107d5c893),SecurityGroupRule(ee3f486d-41f1-4f85-ade7-b7219bf337a1)],shared=False,stateful=True,updated_at=2022-09-25T00:58:03Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:03.562213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-02a29172-57d7-481d-bf69-06efce6a47c3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (862e1068-1716-4ff0-8d9b-cc559f4ca0fd), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:03.563201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-02a29172-57d7-481d-bf69-06efce6a47c3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:03Z,description=,direction='egress',ethertype='IPv6',id=05cf06a9-c1f9-4a2e-a5c3-b7b6da0f91cd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d5f8f084099d4b37b67aba3cda9ecff3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=862e1068-1716-4ff0-8d9b-cc559f4ca0fd,updated_at=2022-09-25T00:58:03Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:03.564206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-02a29172-57d7-481d-bf69-06efce6a47c3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (05cf06a9-c1f9-4a2e-a5c3-b7b6da0f91cd), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:03.564698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-02a29172-57d7-481d-bf69-06efce6a47c3 admin admin] Security group rule updated ['862e1068-1716-4ff0-8d9b-cc559f4ca0fd'] Sep 25 00:58:03.566181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-02a29172-57d7-481d-bf69-06efce6a47c3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:03Z,description=,direction='ingress',ethertype='IPv4',id=73ffede5-748c-4d3e-8480-75c237bc39cb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d5f8f084099d4b37b67aba3cda9ecff3',protocol=,remote_address_group_id=,remote_group_id=862e1068-1716-4ff0-8d9b-cc559f4ca0fd,remote_ip_prefix=,revision_number=0,security_group_id=862e1068-1716-4ff0-8d9b-cc559f4ca0fd,updated_at=2022-09-25T00:58:03Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:03.566709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-02a29172-57d7-481d-bf69-06efce6a47c3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (73ffede5-748c-4d3e-8480-75c237bc39cb), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:03.567417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-02a29172-57d7-481d-bf69-06efce6a47c3 admin admin] Security group rule updated ['862e1068-1716-4ff0-8d9b-cc559f4ca0fd'] Sep 25 00:58:03.568329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-02a29172-57d7-481d-bf69-06efce6a47c3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:03Z,description=,direction='ingress',ethertype='IPv6',id=8d05f554-52bd-41fb-8157-b67107d5c893,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d5f8f084099d4b37b67aba3cda9ecff3',protocol=,remote_address_group_id=,remote_group_id=862e1068-1716-4ff0-8d9b-cc559f4ca0fd,remote_ip_prefix=,revision_number=0,security_group_id=862e1068-1716-4ff0-8d9b-cc559f4ca0fd,updated_at=2022-09-25T00:58:03Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:03.569516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-02a29172-57d7-481d-bf69-06efce6a47c3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (8d05f554-52bd-41fb-8157-b67107d5c893), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:03.570022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-02a29172-57d7-481d-bf69-06efce6a47c3 admin admin] Security group rule updated ['862e1068-1716-4ff0-8d9b-cc559f4ca0fd'] Sep 25 00:58:03.572196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-02a29172-57d7-481d-bf69-06efce6a47c3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:03Z,description=,direction='egress',ethertype='IPv4',id=ee3f486d-41f1-4f85-ade7-b7219bf337a1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d5f8f084099d4b37b67aba3cda9ecff3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=862e1068-1716-4ff0-8d9b-cc559f4ca0fd,updated_at=2022-09-25T00:58:03Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:03.572998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-02a29172-57d7-481d-bf69-06efce6a47c3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (ee3f486d-41f1-4f85-ade7-b7219bf337a1), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:03.574033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-02a29172-57d7-481d-bf69-06efce6a47c3 admin admin] Security group rule updated ['862e1068-1716-4ff0-8d9b-cc559f4ca0fd'] Sep 25 00:58:03.666203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:316 started Sep 25 00:58:03.669184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df55,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=395000000,duration_sec=646,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:03.670197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:58:03.670845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:316 - starting polling. Elapsed:0.005 Sep 25 00:58:03.673814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:03.678339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:316 - port information retrieved. Elapsed:0.012 Sep 25 00:58:03.678909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '68a3f405-e599-4339-b2a8-058311132e20', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', '7d521366-e68f-48bd-a7a8-e2283117a2b7', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', '312a0875-9d08-4c94-b6f3-3135500afa6a', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '4a688d1f-1335-463f-b319-bcba153c442f', '1b8115fa-df9f-4b13-830a-866086f1b68f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', '078c0e3b-64fa-4b32-9903-3d2ac504d9d4', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'de4727a2-569d-44c6-a53e-ecc89817f610'}, 'added': {'078c0e3b-64fa-4b32-9903-3d2ac504d9d4'}, 'removed': set(), 'updated': {'078c0e3b-64fa-4b32-9903-3d2ac504d9d4'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:58:03.679716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '078c0e3b-64fa-4b32-9903-3d2ac504d9d4', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-f9e440d6-f48e-45bb-9a01-3ccd9ccf9488', 'network_id': 'f9e440d6-f48e-45bb-9a01-3ccd9ccf9488', 'port_id': '078c0e3b-64fa-4b32-9903-3d2ac504d9d4', 'mac_address': 'fa:16:3e:51:25:e5', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 66, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd74e111d-e663-49eb-9c15-00f7b719c28d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:58:03.684965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 078c0e3b-64fa-4b32-9903-3d2ac504d9d4 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:58:03.685703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 078c0e3b-64fa-4b32-9903-3d2ac504d9d4 updated. Details: {'device': '078c0e3b-64fa-4b32-9903-3d2ac504d9d4', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-f9e440d6-f48e-45bb-9a01-3ccd9ccf9488', 'network_id': 'f9e440d6-f48e-45bb-9a01-3ccd9ccf9488', 'port_id': '078c0e3b-64fa-4b32-9903-3d2ac504d9d4', 'mac_address': 'fa:16:3e:51:25:e5', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 66, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd74e111d-e663-49eb-9c15-00f7b719c28d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 25 00:58:03.686409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Assigning 10 as local vlan for net-id=f9e440d6-f48e-45bb-9a01-3ccd9ccf9488, seg-id=66 Sep 25 00:58:03.692174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xa5d7ab4a,OFPFlowMod(buffer_id=4294967295,command=0,cookie=13979250796582379444,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4162), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4106}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:03.696358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x7834df57,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4106)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4162}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:03.697747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap078c0e3b-64, col_values=(('tag', 10),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:03.698413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap078c0e3b-64, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:03.699238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap078c0e3b-64, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:03.708892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap078c0e3b-64, col_values=(('other_config', {'net_uuid': 'f9e440d6-f48e-45bb-9a01-3ccd9ccf9488', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '10', 'segmentation_id': '66'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:03.721607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834df59,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 24}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:03.723171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:316 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 20 devices currently available. Time elapsed: 0.044 Sep 25 00:58:03.723769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing device filters for 1 new devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 25 00:58:03.724318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing filters for devices {'078c0e3b-64fa-4b32-9903-3d2ac504d9d4'} Sep 25 00:58:03.725856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:58:03.726394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:58:03.731066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:58:03.755129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-13cdc82f-6576-4a85-829c-78df746a072f admin admin] Resource SecurityGroup deleted: 862e1068-1716-4ff0-8d9b-cc559f4ca0fd {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:03.757347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-13cdc82f-6576-4a85-829c-78df746a072f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (862e1068-1716-4ff0-8d9b-cc559f4ca0fd), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:03.757846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13cdc82f-6576-4a85-829c-78df746a072f admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('862e1068-1716-4ff0-8d9b-cc559f4ca0fd',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:58:03.780846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-13cdc82f-6576-4a85-829c-78df746a072f admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('862e1068-1716-4ff0-8d9b-cc559f4ca0fd',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:58:03.781829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-13cdc82f-6576-4a85-829c-78df746a072f admin admin] Resource SecurityGroupRule deleted: 05cf06a9-c1f9-4a2e-a5c3-b7b6da0f91cd {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:03.782279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-13cdc82f-6576-4a85-829c-78df746a072f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (05cf06a9-c1f9-4a2e-a5c3-b7b6da0f91cd), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:03.782707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-13cdc82f-6576-4a85-829c-78df746a072f admin admin] Security group rule updated ['862e1068-1716-4ff0-8d9b-cc559f4ca0fd'] Sep 25 00:58:03.826457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36f8937-d43a-4790-9409-51a16b799774]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:58:03.827181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:316 - agent port security group processed in 0.148 Sep 25 00:58:03.828807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 078c0e3b-64fa-4b32-9903-3d2ac504d9d4 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:58:03.830715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-13cdc82f-6576-4a85-829c-78df746a072f admin admin] Resource SecurityGroupRule deleted: 73ffede5-748c-4d3e-8480-75c237bc39cb {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:03.831121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-13cdc82f-6576-4a85-829c-78df746a072f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (73ffede5-748c-4d3e-8480-75c237bc39cb), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:03.831635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-13cdc82f-6576-4a85-829c-78df746a072f admin admin] Security group rule updated ['862e1068-1716-4ff0-8d9b-cc559f4ca0fd'] Sep 25 00:58:03.832031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-13cdc82f-6576-4a85-829c-78df746a072f admin admin] Resource SecurityGroupRule deleted: 8d05f554-52bd-41fb-8157-b67107d5c893 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:03.832434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-13cdc82f-6576-4a85-829c-78df746a072f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (8d05f554-52bd-41fb-8157-b67107d5c893), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:03.832840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-13cdc82f-6576-4a85-829c-78df746a072f admin admin] Security group rule updated ['862e1068-1716-4ff0-8d9b-cc559f4ca0fd'] Sep 25 00:58:03.833240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-13cdc82f-6576-4a85-829c-78df746a072f admin admin] Resource SecurityGroupRule deleted: ee3f486d-41f1-4f85-ade7-b7219bf337a1 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:03.833674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-13cdc82f-6576-4a85-829c-78df746a072f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (ee3f486d-41f1-4f85-ade7-b7219bf337a1), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:03.834000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-13cdc82f-6576-4a85-829c-78df746a072f admin admin] Security group rule updated ['862e1068-1716-4ff0-8d9b-cc559f4ca0fd'] Sep 25 00:58:04.183035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['078c0e3b-64fa-4b32-9903-3d2ac504d9d4'] and devices down [] completed. Sep 25 00:58:04.187020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:316 - ports processed. Elapsed:0.519 Sep 25 00:58:04.187847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:316 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.522 Sep 25 00:58:04.271601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Resource Port 078c0e3b-64fa-4b32-9903-3d2ac504d9d4 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:04.272346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (078c0e3b-64fa-4b32-9903-3d2ac504d9d4), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:05.664392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-33b85927-1b43-44ce-ae29-338f55c5c1d6 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:58:05Z,data_plane_status=None,description='',device_id='95fe8ae6-34dd-49d1-84c4-0403b5fc0d07',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2,mac_address=fa:16:3e:e4:77:a7,name='',network_id=f9e440d6-f48e-45bb-9a01-3ccd9ccf9488,numa_affinity_policy=,project_id='b161c2e2dd1f42159dc0d71e8216516c',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:58:05Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:05.669948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-33b85927-1b43-44ce-ae29-338f55c5c1d6 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:05.676678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:317 started Sep 25 00:58:05.693610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df5b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=406000000,duration_sec=648,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:05.696059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:58:05.696811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:317 - starting polling. Elapsed:0.022 Sep 25 00:58:05.700159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:05.705814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:317 - port information retrieved. Elapsed:0.031 Sep 25 00:58:05.707111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '68a3f405-e599-4339-b2a8-058311132e20', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', '7d521366-e68f-48bd-a7a8-e2283117a2b7', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', '312a0875-9d08-4c94-b6f3-3135500afa6a', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '4a688d1f-1335-463f-b319-bcba153c442f', '1b8115fa-df9f-4b13-830a-866086f1b68f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', '078c0e3b-64fa-4b32-9903-3d2ac504d9d4', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'de4727a2-569d-44c6-a53e-ecc89817f610'}, 'added': set(), 'removed': set(), 'updated': {'078c0e3b-64fa-4b32-9903-3d2ac504d9d4'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:58:05.709678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '078c0e3b-64fa-4b32-9903-3d2ac504d9d4', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-f9e440d6-f48e-45bb-9a01-3ccd9ccf9488', 'network_id': 'f9e440d6-f48e-45bb-9a01-3ccd9ccf9488', 'port_id': '078c0e3b-64fa-4b32-9903-3d2ac504d9d4', 'mac_address': 'fa:16:3e:51:25:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 66, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd74e111d-e663-49eb-9c15-00f7b719c28d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:58:05.714534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 078c0e3b-64fa-4b32-9903-3d2ac504d9d4 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:58:05.715545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 078c0e3b-64fa-4b32-9903-3d2ac504d9d4 updated. Details: {'device': '078c0e3b-64fa-4b32-9903-3d2ac504d9d4', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-f9e440d6-f48e-45bb-9a01-3ccd9ccf9488', 'network_id': 'f9e440d6-f48e-45bb-9a01-3ccd9ccf9488', 'port_id': '078c0e3b-64fa-4b32-9903-3d2ac504d9d4', 'mac_address': 'fa:16:3e:51:25:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 66, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd74e111d-e663-49eb-9c15-00f7b719c28d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 10} Sep 25 00:58:05.718937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap078c0e3b-64, col_values=(('tag', 10),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:05.719642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap078c0e3b-64, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:05.720281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap078c0e3b-64, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:05.721085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:58:05.724129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap078c0e3b-64, col_values=(('other_config', {'net_uuid': 'f9e440d6-f48e-45bb-9a01-3ccd9ccf9488', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '66', 'tag': '10'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:05.725280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:58:05.729422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834df5d,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 24}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:05.737598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:317 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 20 devices currently available. Time elapsed: 0.022 Sep 25 00:58:05.739313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refreshing firewall for 1 devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 25 00:58:05.740257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refresh firewall rules Sep 25 00:58:05.742530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:58:05.743074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:58:05.750025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:58:05.803411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d4914b8e-568b-404e-b1e9-b6c91d9be326 None None] Resource Port c41e83db-31a6-4fd6-a328-2ef3b504c9c3 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=c41e83db-31a6-4fd6-a328-2ef3b504c9c3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c41e83db-31a6-4fd6-a328-2ef3b504c9c3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:05.809250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d4914b8e-568b-404e-b1e9-b6c91d9be326 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (c41e83db-31a6-4fd6-a328-2ef3b504c9c3), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:05.850863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edef6bb-6261-4e8f-8d20-bf8e6af2bee2]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:58:05.851467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:317 - agent port security group processed in 0.144 Sep 25 00:58:05.852365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 078c0e3b-64fa-4b32-9903-3d2ac504d9d4 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:58:06.185891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d4914b8e-568b-404e-b1e9-b6c91d9be326 None None] Resource Port c41e83db-31a6-4fd6-a328-2ef3b504c9c3 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c41e83db-31a6-4fd6-a328-2ef3b504c9c3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c41e83db-31a6-4fd6-a328-2ef3b504c9c3,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=c41e83db-31a6-4fd6-a328-2ef3b504c9c3,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:06.186358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d4914b8e-568b-404e-b1e9-b6c91d9be326 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (c41e83db-31a6-4fd6-a328-2ef3b504c9c3), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:06.216405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-33b85927-1b43-44ce-ae29-338f55c5c1d6 admin admin] Received resource Port update without any changes: c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2 {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 25 00:58:06.297590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['078c0e3b-64fa-4b32-9903-3d2ac504d9d4'] and devices down [] completed. Sep 25 00:58:06.297918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:317 - ports processed. Elapsed:0.623 Sep 25 00:58:06.298256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:317 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.624 Sep 25 00:58:06.808175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-df47a8ba-f5b2-4a47-b7c8-36c1b9434107 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:58:06Z,description='tempest-description--1734398270',id=f0d3b914-378e-40fe-b150-c8676dc91021,is_default=False,name='tempest-securitygroup--203677135',project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',revision_number=1,rules=[SecurityGroupRule(0b5e71d7-8c6d-471a-9d67-d729ebe64ff6),SecurityGroupRule(c027b006-f9d5-465c-9199-eef4b69be0e3)],shared=False,stateful=True,updated_at=2022-09-25T00:58:06Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:06.809297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-df47a8ba-f5b2-4a47-b7c8-36c1b9434107 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (f0d3b914-378e-40fe-b150-c8676dc91021), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:06.809960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-df47a8ba-f5b2-4a47-b7c8-36c1b9434107 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:06Z,description=,direction='egress',ethertype='IPv6',id=0b5e71d7-8c6d-471a-9d67-d729ebe64ff6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f0d3b914-378e-40fe-b150-c8676dc91021,updated_at=2022-09-25T00:58:06Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:06.810343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-df47a8ba-f5b2-4a47-b7c8-36c1b9434107 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (0b5e71d7-8c6d-471a-9d67-d729ebe64ff6), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:06.810690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-df47a8ba-f5b2-4a47-b7c8-36c1b9434107 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['f0d3b914-378e-40fe-b150-c8676dc91021'] Sep 25 00:58:06.811386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-df47a8ba-f5b2-4a47-b7c8-36c1b9434107 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:06Z,description=,direction='egress',ethertype='IPv4',id=c027b006-f9d5-465c-9199-eef4b69be0e3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f0d3b914-378e-40fe-b150-c8676dc91021,updated_at=2022-09-25T00:58:06Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:06.811748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-df47a8ba-f5b2-4a47-b7c8-36c1b9434107 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (c027b006-f9d5-465c-9199-eef4b69be0e3), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:06.812255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-df47a8ba-f5b2-4a47-b7c8-36c1b9434107 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['f0d3b914-378e-40fe-b150-c8676dc91021'] Sep 25 00:58:06.847779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["7cfb49b5-dad8-486b-8eae-9261115e5e95","insert","qr-c9cc5d17-94",["set",[]],["map",[["attached-mac","fa:16:3e:e4:77:a7"],["iface-id","c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:58:06.876323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["7cfb49b5-dad8-486b-8eae-9261115e5e95","old",null,["set",[]],null],["","new","qr-c9cc5d17-94",25,["map",[["attached-mac","fa:16:3e:e4:77:a7"],["iface-id","c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:58:06.965234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-22b965ce-4d85-4ccc-88fe-1926566c3511 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:06Z,description='',direction='ingress',ethertype='IPv4',id=337da1e7-c10b-4602-b14e-978e665de34a,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f0d3b914-378e-40fe-b150-c8676dc91021,updated_at=2022-09-25T00:58:06Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:06.966014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-22b965ce-4d85-4ccc-88fe-1926566c3511 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (337da1e7-c10b-4602-b14e-978e665de34a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:06.969349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-22b965ce-4d85-4ccc-88fe-1926566c3511 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['f0d3b914-378e-40fe-b150-c8676dc91021'] Sep 25 00:58:07.130082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b6415e05-a371-4d84-a29b-d01ae628e6f4 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:07Z,description='',direction='ingress',ethertype='IPv4',id=74192d7c-d8ce-43e6-aa07-67e6e7a4940a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f0d3b914-378e-40fe-b150-c8676dc91021,updated_at=2022-09-25T00:58:07Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:07.130565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b6415e05-a371-4d84-a29b-d01ae628e6f4 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (74192d7c-d8ce-43e6-aa07-67e6e7a4940a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:07.131113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b6415e05-a371-4d84-a29b-d01ae628e6f4 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['f0d3b914-378e-40fe-b150-c8676dc91021'] Sep 25 00:58:07.530785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["be4d390f-71c4-4f2f-9612-a73c842f3514","insert","qg-c41e83db-31",["set",[]],["map",[["attached-mac","fa:16:3e:b4:23:a7"],["iface-id","c41e83db-31a6-4fd6-a328-2ef3b504c9c3"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:58:07.552529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["be4d390f-71c4-4f2f-9612-a73c842f3514","old",null,["set",[]],null],["","new","qg-c41e83db-31",26,["map",[["attached-mac","fa:16:3e:b4:23:a7"],["iface-id","c41e83db-31a6-4fd6-a328-2ef3b504c9c3"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:58:07.637892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d7cd6784-9a42-4ef7-b2d7-bc5e8c0e3297 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:58:07Z,description='Default security group',id=d56f1d30-4c79-465a-93d9-903b9f37fd08,is_default=True,name='default',project_id='31719d4e28f048bbbf6e307df745e648',revision_number=1,rules=[SecurityGroupRule(703f2e6e-2c9c-446b-aa91-3f3f0f161ee6),SecurityGroupRule(705b8f34-a98b-48a1-af93-8f465637ed4c),SecurityGroupRule(a7e1ef1c-29a6-4e52-b471-3ced707c7905),SecurityGroupRule(b3cf8404-5817-438f-9574-83674e2e4384)],shared=False,stateful=True,updated_at=2022-09-25T00:58:07Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:07.638279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d7cd6784-9a42-4ef7-b2d7-bc5e8c0e3297 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (d56f1d30-4c79-465a-93d9-903b9f37fd08), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:07.640480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d7cd6784-9a42-4ef7-b2d7-bc5e8c0e3297 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:07Z,description=,direction='egress',ethertype='IPv4',id=703f2e6e-2c9c-446b-aa91-3f3f0f161ee6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='31719d4e28f048bbbf6e307df745e648',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d56f1d30-4c79-465a-93d9-903b9f37fd08,updated_at=2022-09-25T00:58:07Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:07.640890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d7cd6784-9a42-4ef7-b2d7-bc5e8c0e3297 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (703f2e6e-2c9c-446b-aa91-3f3f0f161ee6), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:07.641229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d7cd6784-9a42-4ef7-b2d7-bc5e8c0e3297 admin admin] Security group rule updated ['d56f1d30-4c79-465a-93d9-903b9f37fd08'] Sep 25 00:58:07.642425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d7cd6784-9a42-4ef7-b2d7-bc5e8c0e3297 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:07Z,description=,direction='egress',ethertype='IPv6',id=705b8f34-a98b-48a1-af93-8f465637ed4c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='31719d4e28f048bbbf6e307df745e648',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d56f1d30-4c79-465a-93d9-903b9f37fd08,updated_at=2022-09-25T00:58:07Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:07.642787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d7cd6784-9a42-4ef7-b2d7-bc5e8c0e3297 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (705b8f34-a98b-48a1-af93-8f465637ed4c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:07.643119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d7cd6784-9a42-4ef7-b2d7-bc5e8c0e3297 admin admin] Security group rule updated ['d56f1d30-4c79-465a-93d9-903b9f37fd08'] Sep 25 00:58:07.646038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d7cd6784-9a42-4ef7-b2d7-bc5e8c0e3297 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:07Z,description=,direction='ingress',ethertype='IPv4',id=a7e1ef1c-29a6-4e52-b471-3ced707c7905,normalized_cidr=None,port_range_max=,port_range_min=,project_id='31719d4e28f048bbbf6e307df745e648',protocol=,remote_address_group_id=,remote_group_id=d56f1d30-4c79-465a-93d9-903b9f37fd08,remote_ip_prefix=,revision_number=0,security_group_id=d56f1d30-4c79-465a-93d9-903b9f37fd08,updated_at=2022-09-25T00:58:07Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:07.647999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d7cd6784-9a42-4ef7-b2d7-bc5e8c0e3297 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (a7e1ef1c-29a6-4e52-b471-3ced707c7905), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:07.648581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d7cd6784-9a42-4ef7-b2d7-bc5e8c0e3297 admin admin] Security group rule updated ['d56f1d30-4c79-465a-93d9-903b9f37fd08'] Sep 25 00:58:07.650566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d7cd6784-9a42-4ef7-b2d7-bc5e8c0e3297 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:07Z,description=,direction='ingress',ethertype='IPv6',id=b3cf8404-5817-438f-9574-83674e2e4384,normalized_cidr=None,port_range_max=,port_range_min=,project_id='31719d4e28f048bbbf6e307df745e648',protocol=,remote_address_group_id=,remote_group_id=d56f1d30-4c79-465a-93d9-903b9f37fd08,remote_ip_prefix=,revision_number=0,security_group_id=d56f1d30-4c79-465a-93d9-903b9f37fd08,updated_at=2022-09-25T00:58:07Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:07.652393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d7cd6784-9a42-4ef7-b2d7-bc5e8c0e3297 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (b3cf8404-5817-438f-9574-83674e2e4384), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:07.654105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d7cd6784-9a42-4ef7-b2d7-bc5e8c0e3297 admin admin] Security group rule updated ['d56f1d30-4c79-465a-93d9-903b9f37fd08'] Sep 25 00:58:07.676393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:318 started Sep 25 00:58:07.681808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df5f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=406000000,duration_sec=650,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:07.682695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:58:07.684897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:318 - starting polling. Elapsed:0.009 Sep 25 00:58:07.688210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:07.694761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:318 - port information retrieved. Elapsed:0.019 Sep 25 00:58:07.695461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '68a3f405-e599-4339-b2a8-058311132e20', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', '7d521366-e68f-48bd-a7a8-e2283117a2b7', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2', '312a0875-9d08-4c94-b6f3-3135500afa6a', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '4a688d1f-1335-463f-b319-bcba153c442f', '1b8115fa-df9f-4b13-830a-866086f1b68f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'c41e83db-31a6-4fd6-a328-2ef3b504c9c3', '078c0e3b-64fa-4b32-9903-3d2ac504d9d4', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'de4727a2-569d-44c6-a53e-ecc89817f610'}, 'added': {'c41e83db-31a6-4fd6-a328-2ef3b504c9c3', 'c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2'}, 'removed': set(), 'updated': {'c41e83db-31a6-4fd6-a328-2ef3b504c9c3'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:58:07.696328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': 'c41e83db-31a6-4fd6-a328-2ef3b504c9c3', 'device_id': '95fe8ae6-34dd-49d1-84c4-0403b5fc0d07', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': 'c41e83db-31a6-4fd6-a328-2ef3b504c9c3', 'mac_address': 'fa:16:3e:b4:23:a7', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.2'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:58:07.701444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: WARNING neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:58:05Z,data_plane_status=None,description='',device_id='95fe8ae6-34dd-49d1-84c4-0403b5fc0d07',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2,mac_address=fa:16:3e:e4:77:a7,name='',network_id=f9e440d6-f48e-45bb-9a01-3ccd9ccf9488,numa_affinity_policy=,project_id='b161c2e2dd1f42159dc0d71e8216516c',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:58:05Z) is not bound. Sep 25 00:58:07.707845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: c41e83db-31a6-4fd6-a328-2ef3b504c9c3 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:58:07.708485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port c41e83db-31a6-4fd6-a328-2ef3b504c9c3 updated. Details: {'device': 'c41e83db-31a6-4fd6-a328-2ef3b504c9c3', 'device_id': '95fe8ae6-34dd-49d1-84c4-0403b5fc0d07', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': 'c41e83db-31a6-4fd6-a328-2ef3b504c9c3', 'mac_address': 'fa:16:3e:b4:23:a7', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.2'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 25 00:58:07.709711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-c41e83db-31, col_values=(('tag', 2),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:07.710991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-c41e83db-31, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:07.712370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-c41e83db-31, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:07.743533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-c41e83db-31, col_values=(('other_config', {'net_uuid': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:07.763101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834df61,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 26}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:07.763448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:58:07.766676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Device c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2 not defined on plugin or binding failed Sep 25 00:58:07.767439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:318 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 22 devices currently available. Time elapsed: 0.071 Sep 25 00:58:07.767948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing device filters for 2 new devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 25 00:58:07.769069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing filters for devices {'c41e83db-31a6-4fd6-a328-2ef3b504c9c3', 'c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2'} Sep 25 00:58:07.772719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:58:07.775091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:58:07.785475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:58:07.834286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6d8028-4059-4d30-baa9-35f7016d9dab]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:58:07.835825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:318 - agent port security group processed in 0.140 Sep 25 00:58:07.837047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for c41e83db-31a6-4fd6-a328-2ef3b504c9c3 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:58:07.881697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d7cd6784-9a42-4ef7-b2d7-bc5e8c0e3297 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-25T00:58:07Z,description='',dns_domain=None,id=305a606b-4752-46cc-b1fb-85da780b88ce,mtu=1500,name='tempest-TestMinimumBasicScenario-1494453102-network',project_id='31719d4e28f048bbbf6e307df745e648',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(305a606b-4752-46cc-b1fb-85da780b88ce),segments=[NetworkSegment(7a66e3b5-b3f5-43ff-ae94-f02bf2a9360f)],shared=False,status='ACTIVE',updated_at=2022-09-25T00:58:07Z,vlan_transparent=) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:07.882677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d7cd6784-9a42-4ef7-b2d7-bc5e8c0e3297 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (305a606b-4752-46cc-b1fb-85da780b88ce), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:07.988647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager [None req-d7cd6784-9a42-4ef7-b2d7-bc5e8c0e3297 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 305a606b-4752-46cc-b1fb-85da780b88ce with segmentation id not found. Sep 25 00:58:07.988647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 25 00:58:07.988647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 25 00:58:07.988647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 25 00:58:07.988647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 25 00:58:07.988647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 25 00:58:07.988647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 25 00:58:07.988647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 25 00:58:07.988647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 25 00:58:07.988647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 25 00:58:07.988647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 25 00:58:07.988647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 25 00:58:07.988647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 25 00:58:07.989586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 25 00:58:07.989586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 25 00:58:07.989586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 25 00:58:07.989586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 305a606b-4752-46cc-b1fb-85da780b88ce with segmentation id not found. Sep 25 00:58:07.989586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Sep 25 00:58:08.035235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fe8cf4e9-8b57-4d8d-815d-c769931901db tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:58:07Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=5782af87-0b4f-4824-aed9-541addf429b2,mac_address=fa:16:3e:46:70:d9,name='',network_id=62195cd6-54fa-4e24-9d47-ae0de6356ac2,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(5782af87-0b4f-4824-aed9-541addf429b2),security_group_ids=set([]),status='N/A',updated_at=2022-09-25T00:58:07Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:08.036379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fe8cf4e9-8b57-4d8d-815d-c769931901db tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (5782af87-0b4f-4824-aed9-541addf429b2), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:08.148334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['c41e83db-31a6-4fd6-a328-2ef3b504c9c3'] and devices down [] completed. Sep 25 00:58:08.148665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:318 - ports processed. Elapsed:0.473 Sep 25 00:58:08.149062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:318 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 1, 'removed': 0}}. Elapsed:0.473 Sep 25 00:58:08.236587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Resource Port c41e83db-31a6-4fd6-a328-2ef3b504c9c3 updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=c41e83db-31a6-4fd6-a328-2ef3b504c9c3,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=c41e83db-31a6-4fd6-a328-2ef3b504c9c3,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)], 'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:08.237897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (c41e83db-31a6-4fd6-a328-2ef3b504c9c3), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:08.304700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1408f3f9-ec62-4009-8086-9cd6046a1e0f admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(676cdf40-1e2f-466f-9ae4-578a478e2d94)],cidr=172.20.0.0/28,created_at=2022-09-25T00:58:08Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=4f943db5-728a-408e-91ba-0a8afa5e45da,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestMinimumBasicScenario-1494453102-subnet',network_id=305a606b-4752-46cc-b1fb-85da780b88ce,project_id='31719d4e28f048bbbf6e307df745e648',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-25T00:58:08Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:08.305089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1408f3f9-ec62-4009-8086-9cd6046a1e0f admin admin] Publish callbacks [] for Subnet (4f943db5-728a-408e-91ba-0a8afa5e45da), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:08.610159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fe8cf4e9-8b57-4d8d-815d-c769931901db tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource Port 5782af87-0b4f-4824-aed9-541addf429b2 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '84ca9031-fd56-45fa-81cb-ae7e9ce8d58f'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:08.610549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fe8cf4e9-8b57-4d8d-815d-c769931901db tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (5782af87-0b4f-4824-aed9-541addf429b2), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:09.264060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b3ab171f-bcad-4663-9f34-e5f4c53464e9 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:58:08Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-305a606b-4752-46cc-b1fb-85da780b88ce',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=ce1017e5-9b95-4c64-a292-cd0bafd98099,mac_address=fa:16:3e:25:3c:fc,name='',network_id=305a606b-4752-46cc-b1fb-85da780b88ce,numa_affinity_policy=,project_id='31719d4e28f048bbbf6e307df745e648',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(ce1017e5-9b95-4c64-a292-cd0bafd98099),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:58:09Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:09.266831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b3ab171f-bcad-4663-9f34-e5f4c53464e9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (ce1017e5-9b95-4c64-a292-cd0bafd98099), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:09.624934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b3ab171f-bcad-4663-9f34-e5f4c53464e9 None None] Resource Port ce1017e5-9b95-4c64-a292-cd0bafd98099 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=ce1017e5-9b95-4c64-a292-cd0bafd98099,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=ce1017e5-9b95-4c64-a292-cd0bafd98099,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=ce1017e5-9b95-4c64-a292-cd0bafd98099,segment=NetworkSegment(7a66e3b5-b3f5-43ff-ae94-f02bf2a9360f),segment_id=7a66e3b5-b3f5-43ff-ae94-f02bf2a9360f)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:09.625441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b3ab171f-bcad-4663-9f34-e5f4c53464e9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (ce1017e5-9b95-4c64-a292-cd0bafd98099), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:09.677696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:319 started Sep 25 00:58:09.680292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df63,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=406000000,duration_sec=652,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:09.681027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:58:09.681594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:319 - starting polling. Elapsed:0.004 Sep 25 00:58:09.685194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:09.689215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:319 - port information retrieved. Elapsed:0.012 Sep 25 00:58:09.689570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '68a3f405-e599-4339-b2a8-058311132e20', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', '7d521366-e68f-48bd-a7a8-e2283117a2b7', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2', '312a0875-9d08-4c94-b6f3-3135500afa6a', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '4a688d1f-1335-463f-b319-bcba153c442f', '1b8115fa-df9f-4b13-830a-866086f1b68f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'c41e83db-31a6-4fd6-a328-2ef3b504c9c3', '078c0e3b-64fa-4b32-9903-3d2ac504d9d4', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'de4727a2-569d-44c6-a53e-ecc89817f610'}, 'added': set(), 'removed': set(), 'updated': {'c41e83db-31a6-4fd6-a328-2ef3b504c9c3'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:58:09.690420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': 'c41e83db-31a6-4fd6-a328-2ef3b504c9c3', 'device_id': '95fe8ae6-34dd-49d1-84c4-0403b5fc0d07', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': 'c41e83db-31a6-4fd6-a328-2ef3b504c9c3', 'mac_address': 'fa:16:3e:b4:23:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.2'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:58:09.695409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: c41e83db-31a6-4fd6-a328-2ef3b504c9c3 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:58:09.696177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port c41e83db-31a6-4fd6-a328-2ef3b504c9c3 updated. Details: {'device': 'c41e83db-31a6-4fd6-a328-2ef3b504c9c3', 'device_id': '95fe8ae6-34dd-49d1-84c4-0403b5fc0d07', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': 'c41e83db-31a6-4fd6-a328-2ef3b504c9c3', 'mac_address': 'fa:16:3e:b4:23:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.2'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 25 00:58:09.697666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-c41e83db-31, col_values=(('tag', 2),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:09.698282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-c41e83db-31, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:09.698939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-c41e83db-31, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:09.700578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:58:09.702193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-c41e83db-31, col_values=(('other_config', {'net_uuid': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:09.704328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:58:09.707738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834df65,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 26}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:09.708252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:319 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 22 devices currently available. Time elapsed: 0.018 Sep 25 00:58:09.708765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refreshing firewall for 1 devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 25 00:58:09.709182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refresh firewall rules Sep 25 00:58:09.710859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:58:09.711703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:58:09.717666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:58:09.775373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[61eea38b-ee74-46b9-a7f9-bcc747323fd3]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:58:09.775858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:319 - agent port security group processed in 0.086 Sep 25 00:58:09.776700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for c41e83db-31a6-4fd6-a328-2ef3b504c9c3 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:58:09.797565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["29cf924b-2794-431e-a2f4-afa460b6231a","insert","tapce1017e5-9b",["set",[]],["map",[["attached-mac","fa:16:3e:25:3c:fc"],["iface-id","ce1017e5-9b95-4c64-a292-cd0bafd98099"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:58:09.840655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["29cf924b-2794-431e-a2f4-afa460b6231a","old",null,["set",[]],null],["","new","tapce1017e5-9b",27,["map",[["attached-mac","fa:16:3e:25:3c:fc"],["iface-id","ce1017e5-9b95-4c64-a292-cd0bafd98099"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:58:09.844886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-25b29eab-4837-475c-9d03-bfa8a5a59dce admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:58:09Z,data_plane_status=None,description='',device_id='2900192a-2a98-46c6-beef-900d41ac2156',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=d4dca6ad-037a-430a-80c1-dd62be445e07,mac_address=fa:16:3e:73:4a:1e,name='',network_id=62195cd6-54fa-4e24-9d47-ae0de6356ac2,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(d4dca6ad-037a-430a-80c1-dd62be445e07),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:58:09Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:09.847772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-25b29eab-4837-475c-9d03-bfa8a5a59dce admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (d4dca6ad-037a-430a-80c1-dd62be445e07), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:10.186957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['c41e83db-31a6-4fd6-a328-2ef3b504c9c3'] and devices down [] completed. Sep 25 00:58:10.187281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:319 - ports processed. Elapsed:0.510 Sep 25 00:58:10.187626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:319 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.510 Sep 25 00:58:11.047413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e565bc83-7dde-4978-a993-6334c017c90d None None] Resource Port c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:11.048071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e565bc83-7dde-4978-a993-6334c017c90d None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:11.399441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e565bc83-7dde-4978-a993-6334c017c90d None None] Resource Port c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2,segment=NetworkSegment(d3b4c62f-808e-4358-bc7d-2cd03571d715),segment_id=d3b4c62f-808e-4358-bc7d-2cd03571d715)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:11.399841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e565bc83-7dde-4978-a993-6334c017c90d None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:11.678676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:320 started Sep 25 00:58:11.681512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df67,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=407000000,duration_sec=654,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:11.682122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:58:11.682677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:320 - starting polling. Elapsed:0.004 Sep 25 00:58:11.685940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:11.690222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:320 - port information retrieved. Elapsed:0.012 Sep 25 00:58:11.691427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '68a3f405-e599-4339-b2a8-058311132e20', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', '7d521366-e68f-48bd-a7a8-e2283117a2b7', 'ce1017e5-9b95-4c64-a292-cd0bafd98099', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2', '312a0875-9d08-4c94-b6f3-3135500afa6a', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '4a688d1f-1335-463f-b319-bcba153c442f', '1b8115fa-df9f-4b13-830a-866086f1b68f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'c41e83db-31a6-4fd6-a328-2ef3b504c9c3', '078c0e3b-64fa-4b32-9903-3d2ac504d9d4', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'de4727a2-569d-44c6-a53e-ecc89817f610'}, 'added': {'ce1017e5-9b95-4c64-a292-cd0bafd98099'}, 'removed': set(), 'updated': {'c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:58:11.692016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': 'ce1017e5-9b95-4c64-a292-cd0bafd98099', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-305a606b-4752-46cc-b1fb-85da780b88ce', 'network_id': '305a606b-4752-46cc-b1fb-85da780b88ce', 'port_id': 'ce1017e5-9b95-4c64-a292-cd0bafd98099', 'mac_address': 'fa:16:3e:25:3c:fc', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 78, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '4f943db5-728a-408e-91ba-0a8afa5e45da', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:58:11.702116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': 'c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2', 'device_id': '95fe8ae6-34dd-49d1-84c4-0403b5fc0d07', 'network_id': 'f9e440d6-f48e-45bb-9a01-3ccd9ccf9488', 'port_id': 'c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2', 'mac_address': 'fa:16:3e:e4:77:a7', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 66, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd74e111d-e663-49eb-9c15-00f7b719c28d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:58:11.714947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: ce1017e5-9b95-4c64-a292-cd0bafd98099 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:58:11.716471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port ce1017e5-9b95-4c64-a292-cd0bafd98099 updated. Details: {'device': 'ce1017e5-9b95-4c64-a292-cd0bafd98099', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-305a606b-4752-46cc-b1fb-85da780b88ce', 'network_id': '305a606b-4752-46cc-b1fb-85da780b88ce', 'port_id': 'ce1017e5-9b95-4c64-a292-cd0bafd98099', 'mac_address': 'fa:16:3e:25:3c:fc', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 78, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '4f943db5-728a-408e-91ba-0a8afa5e45da', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 25 00:58:11.733494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Assigning 11 as local vlan for net-id=305a606b-4752-46cc-b1fb-85da780b88ce, seg-id=78 Sep 25 00:58:11.750677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xa5d7ab4c,OFPFlowMod(buffer_id=4294967295,command=0,cookie=13979250796582379444,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4174), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4107}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:11.757955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x7834df69,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4107)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4174}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:11.762276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapce1017e5-9b, col_values=(('tag', 11),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:11.765203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapce1017e5-9b, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:11.765807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapce1017e5-9b, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:11.774560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapce1017e5-9b, col_values=(('other_config', {'net_uuid': '305a606b-4752-46cc-b1fb-85da780b88ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '11', 'segmentation_id': '78'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:11.788725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834df6b,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 27}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:11.791020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:58:11.791842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2 updated. Details: {'device': 'c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2', 'device_id': '95fe8ae6-34dd-49d1-84c4-0403b5fc0d07', 'network_id': 'f9e440d6-f48e-45bb-9a01-3ccd9ccf9488', 'port_id': 'c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2', 'mac_address': 'fa:16:3e:e4:77:a7', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 66, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd74e111d-e663-49eb-9c15-00f7b719c28d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 10} Sep 25 00:58:11.793951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-c9cc5d17-94, col_values=(('tag', 10),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:11.794684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-c9cc5d17-94, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:11.795393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-c9cc5d17-94, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:11.810476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-c9cc5d17-94, col_values=(('other_config', {'net_uuid': 'f9e440d6-f48e-45bb-9a01-3ccd9ccf9488', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '10', 'segmentation_id': '66'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:11.829871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834df6d,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 25}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:11.830422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:320 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 23 devices currently available. Time elapsed: 0.139 Sep 25 00:58:11.831100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing device filters for 1 new devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 25 00:58:11.831618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing filters for devices {'ce1017e5-9b95-4c64-a292-cd0bafd98099'} Sep 25 00:58:11.833800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:58:11.834256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:58:11.842059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:58:11.913581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bd1f57-07c1-49bc-be73-d3613d3fab5c]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:58:11.914607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refreshing firewall for 1 devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 25 00:58:11.914871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refresh firewall rules Sep 25 00:58:11.916211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:58:11.916530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:58:11.922723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:58:11.993929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b177427-0d69-4ab3-a080-4de718c7934c]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:58:11.994543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:320 - agent port security group processed in 0.303 Sep 25 00:58:11.995528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for ce1017e5-9b95-4c64-a292-cd0bafd98099 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:58:11.995841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:58:12.055351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a8f60b13-9785-4f46-8e80-c1957fdf2064 None None] Resource Port c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:12.056003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a8f60b13-9785-4f46-8e80-c1957fdf2064 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:12.910136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d111c45f-23df-48cb-986a-8773b7fb7648 None None] Resource Port ce1017e5-9b95-4c64-a292-cd0bafd98099 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:12.911008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d111c45f-23df-48cb-986a-8773b7fb7648 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (ce1017e5-9b95-4c64-a292-cd0bafd98099), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:13.265869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a6717b46-a661-4daf-9955-8364dcb40b2d admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:58:12Z,data_plane_status=None,description='',device_id='2900192a-2a98-46c6-beef-900d41ac2156',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=223185f3-b5c4-4c49-9934-15eec28454bf,mac_address=fa:16:3e:50:42:1d,name='',network_id=305a606b-4752-46cc-b1fb-85da780b88ce,numa_affinity_policy=,project_id='31719d4e28f048bbbf6e307df745e648',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(223185f3-b5c4-4c49-9934-15eec28454bf),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:58:12Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:13.267016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a6717b46-a661-4daf-9955-8364dcb40b2d admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (223185f3-b5c4-4c49-9934-15eec28454bf), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:13.330932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-026fe4af-9c35-4491-9e78-0d6fc13a8dc6 None None] Resource Port d4dca6ad-037a-430a-80c1-dd62be445e07 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=d4dca6ad-037a-430a-80c1-dd62be445e07,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=d4dca6ad-037a-430a-80c1-dd62be445e07,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:13.331334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-026fe4af-9c35-4491-9e78-0d6fc13a8dc6 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (d4dca6ad-037a-430a-80c1-dd62be445e07), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:13.348245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-740e817d-4c60-4aa2-b1e6-c285f7cde272 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:58:13Z,description='tempest-description--288773846',id=eeea7474-c761-4d5f-be6e-c79f9aedf9b8,is_default=False,name='tempest-securitygroup--128480623',project_id='28568584195d475fbc52d76185e09044',revision_number=1,rules=[SecurityGroupRule(6909a534-ff48-4169-ab61-0e2f22bfdc61),SecurityGroupRule(b3943ffe-bfb9-4fb3-90cb-737091f41c07)],shared=False,stateful=True,updated_at=2022-09-25T00:58:13Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:13.348942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-740e817d-4c60-4aa2-b1e6-c285f7cde272 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (eeea7474-c761-4d5f-be6e-c79f9aedf9b8), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:13.349787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-740e817d-4c60-4aa2-b1e6-c285f7cde272 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:13Z,description=,direction='egress',ethertype='IPv4',id=6909a534-ff48-4169-ab61-0e2f22bfdc61,normalized_cidr=None,port_range_max=,port_range_min=,project_id='28568584195d475fbc52d76185e09044',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=eeea7474-c761-4d5f-be6e-c79f9aedf9b8,updated_at=2022-09-25T00:58:13Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:13.350158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-740e817d-4c60-4aa2-b1e6-c285f7cde272 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (6909a534-ff48-4169-ab61-0e2f22bfdc61), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:13.350500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-740e817d-4c60-4aa2-b1e6-c285f7cde272 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Security group rule updated ['eeea7474-c761-4d5f-be6e-c79f9aedf9b8'] Sep 25 00:58:13.351192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-740e817d-4c60-4aa2-b1e6-c285f7cde272 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:13Z,description=,direction='egress',ethertype='IPv6',id=b3943ffe-bfb9-4fb3-90cb-737091f41c07,normalized_cidr=None,port_range_max=,port_range_min=,project_id='28568584195d475fbc52d76185e09044',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=eeea7474-c761-4d5f-be6e-c79f9aedf9b8,updated_at=2022-09-25T00:58:13Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:13.351561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-740e817d-4c60-4aa2-b1e6-c285f7cde272 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (b3943ffe-bfb9-4fb3-90cb-737091f41c07), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:13.353191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-740e817d-4c60-4aa2-b1e6-c285f7cde272 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Security group rule updated ['eeea7474-c761-4d5f-be6e-c79f9aedf9b8'] Sep 25 00:58:13.521884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-37cab12f-2e52-498c-8706-dcdaaa6cba60 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:13Z,description='',direction='ingress',ethertype='IPv4',id=9b5e3393-9aff-42f6-874f-3fc019fd7fe4,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='28568584195d475fbc52d76185e09044',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=eeea7474-c761-4d5f-be6e-c79f9aedf9b8,updated_at=2022-09-25T00:58:13Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:13.523268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-37cab12f-2e52-498c-8706-dcdaaa6cba60 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (9b5e3393-9aff-42f6-874f-3fc019fd7fe4), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:13.523841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-37cab12f-2e52-498c-8706-dcdaaa6cba60 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Security group rule updated ['eeea7474-c761-4d5f-be6e-c79f9aedf9b8'] Sep 25 00:58:13.662551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-026fe4af-9c35-4491-9e78-0d6fc13a8dc6 None None] Resource Port d4dca6ad-037a-430a-80c1-dd62be445e07 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=d4dca6ad-037a-430a-80c1-dd62be445e07,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=d4dca6ad-037a-430a-80c1-dd62be445e07,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=d4dca6ad-037a-430a-80c1-dd62be445e07,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:13.663226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-026fe4af-9c35-4491-9e78-0d6fc13a8dc6 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (d4dca6ad-037a-430a-80c1-dd62be445e07), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:13.760191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-70cc7d0e-0b4a-4a5a-8269-4fec6cd140a6 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:13Z,description='',direction='ingress',ethertype='IPv4',id=29fddec4-055c-449d-b13b-a09963536b0a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='28568584195d475fbc52d76185e09044',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=eeea7474-c761-4d5f-be6e-c79f9aedf9b8,updated_at=2022-09-25T00:58:13Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:13.761053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-70cc7d0e-0b4a-4a5a-8269-4fec6cd140a6 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (29fddec4-055c-449d-b13b-a09963536b0a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:13.761437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-70cc7d0e-0b4a-4a5a-8269-4fec6cd140a6 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Security group rule updated ['eeea7474-c761-4d5f-be6e-c79f9aedf9b8'] Sep 25 00:58:13.889035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a6717b46-a661-4daf-9955-8364dcb40b2d admin admin] Received resource Port update without any changes: 223185f3-b5c4-4c49-9934-15eec28454bf {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 25 00:58:13.946824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['ce1017e5-9b95-4c64-a292-cd0bafd98099', 'c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2'] and devices down [] completed. Sep 25 00:58:13.947539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:320 - ports processed. Elapsed:2.269 Sep 25 00:58:13.948784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:320 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:2.270 Sep 25 00:58:13.950475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Loop iteration exceeded interval (2 vs. 2.2702078819274902)! {{(pid=107261) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Sep 25 00:58:13.951012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:321 started Sep 25 00:58:13.955225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df6f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=680000000,duration_sec=656,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:13.956898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:58:13.961107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:321 - starting polling. Elapsed:0.010 Sep 25 00:58:13.964622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:13.970772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:321 - port information retrieved. Elapsed:0.018 Sep 25 00:58:13.972615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '68a3f405-e599-4339-b2a8-058311132e20', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', '7d521366-e68f-48bd-a7a8-e2283117a2b7', 'ce1017e5-9b95-4c64-a292-cd0bafd98099', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2', '312a0875-9d08-4c94-b6f3-3135500afa6a', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '4a688d1f-1335-463f-b319-bcba153c442f', '1b8115fa-df9f-4b13-830a-866086f1b68f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'c41e83db-31a6-4fd6-a328-2ef3b504c9c3', '078c0e3b-64fa-4b32-9903-3d2ac504d9d4', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'de4727a2-569d-44c6-a53e-ecc89817f610'}, 'added': set(), 'removed': set(), 'updated': {'ce1017e5-9b95-4c64-a292-cd0bafd98099', 'c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:58:13.973649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': 'ce1017e5-9b95-4c64-a292-cd0bafd98099', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-305a606b-4752-46cc-b1fb-85da780b88ce', 'network_id': '305a606b-4752-46cc-b1fb-85da780b88ce', 'port_id': 'ce1017e5-9b95-4c64-a292-cd0bafd98099', 'mac_address': 'fa:16:3e:25:3c:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 78, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '4f943db5-728a-408e-91ba-0a8afa5e45da', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:58:13.975674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': 'c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2', 'device_id': '95fe8ae6-34dd-49d1-84c4-0403b5fc0d07', 'network_id': 'f9e440d6-f48e-45bb-9a01-3ccd9ccf9488', 'port_id': 'c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2', 'mac_address': 'fa:16:3e:e4:77:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 66, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd74e111d-e663-49eb-9c15-00f7b719c28d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:58:13.984466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: ce1017e5-9b95-4c64-a292-cd0bafd98099 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:58:13.984812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port ce1017e5-9b95-4c64-a292-cd0bafd98099 updated. Details: {'device': 'ce1017e5-9b95-4c64-a292-cd0bafd98099', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-305a606b-4752-46cc-b1fb-85da780b88ce', 'network_id': '305a606b-4752-46cc-b1fb-85da780b88ce', 'port_id': 'ce1017e5-9b95-4c64-a292-cd0bafd98099', 'mac_address': 'fa:16:3e:25:3c:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 78, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '4f943db5-728a-408e-91ba-0a8afa5e45da', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 11} Sep 25 00:58:13.985926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapce1017e5-9b, col_values=(('tag', 11),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:13.986352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapce1017e5-9b, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:13.986793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapce1017e5-9b, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:13.988077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:58:13.990379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapce1017e5-9b, col_values=(('other_config', {'net_uuid': '305a606b-4752-46cc-b1fb-85da780b88ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '78', 'tag': '11'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:13.991701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:58:13.994832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834df71,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 27}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:13.995416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:58:13.995742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2 updated. Details: {'device': 'c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2', 'device_id': '95fe8ae6-34dd-49d1-84c4-0403b5fc0d07', 'network_id': 'f9e440d6-f48e-45bb-9a01-3ccd9ccf9488', 'port_id': 'c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2', 'mac_address': 'fa:16:3e:e4:77:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 66, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd74e111d-e663-49eb-9c15-00f7b719c28d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 10} Sep 25 00:58:13.997192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-c9cc5d17-94, col_values=(('tag', 10),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:13.998093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-c9cc5d17-94, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:13.998794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-c9cc5d17-94, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:13.999672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:58:14.001522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-c9cc5d17-94, col_values=(('other_config', {'net_uuid': 'f9e440d6-f48e-45bb-9a01-3ccd9ccf9488', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '66', 'tag': '10'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:14.003473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:58:14.006532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834df73,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 25}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:14.007091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:321 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 23 devices currently available. Time elapsed: 0.034 Sep 25 00:58:14.007630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refreshing firewall for 2 devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 25 00:58:14.008172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refresh firewall rules Sep 25 00:58:14.010172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:58:14.010647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:58:14.018062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 4 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:58:14.078488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf176e24-491b-4020-bc17-d921cdc69e40]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:58:14.079454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:321 - agent port security group processed in 0.106 Sep 25 00:58:14.080781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for ce1017e5-9b95-4c64-a292-cd0bafd98099 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:58:14.081786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:58:14.477752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-02303532-0fc6-4df7-b640-3faf96720e40 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:58:13Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=17a80ba6-c081-4c9d-a08c-8d5766a6f9f1,mac_address=fa:16:3e:a4:c7:c0,name='',network_id=62195cd6-54fa-4e24-9d47-ae0de6356ac2,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(17a80ba6-c081-4c9d-a08c-8d5766a6f9f1),security_group_ids=set([]),status='N/A',updated_at=2022-09-25T00:58:14Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:14.486762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-02303532-0fc6-4df7-b640-3faf96720e40 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (17a80ba6-c081-4c9d-a08c-8d5766a6f9f1), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:14.660697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["bd65d08a-7f32-4fbe-ae9e-26c2e0c43058","insert","qr-223185f3-b5",["set",[]],["map",[["attached-mac","fa:16:3e:50:42:1d"],["iface-id","223185f3-b5c4-4c49-9934-15eec28454bf"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:58:14.692564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["bd65d08a-7f32-4fbe-ae9e-26c2e0c43058","old",null,["set",[]],null],["","new","qr-223185f3-b5",28,["map",[["attached-mac","fa:16:3e:50:42:1d"],["iface-id","223185f3-b5c4-4c49-9934-15eec28454bf"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:58:14.701341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['ce1017e5-9b95-4c64-a292-cd0bafd98099', 'c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2'] and devices down [] completed. Sep 25 00:58:14.701866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:321 - ports processed. Elapsed:0.751 Sep 25 00:58:14.702238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:321 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 2, 'removed': 0}}. Elapsed:0.751 Sep 25 00:58:14.988868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-02303532-0fc6-4df7-b640-3faf96720e40 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Resource Port 17a80ba6-c081-4c9d-a08c-8d5766a6f9f1 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '704ea153-02c8-4eb3-bdfc-b3a4e92c135c'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:14.989250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-02303532-0fc6-4df7-b640-3faf96720e40 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (17a80ba6-c081-4c9d-a08c-8d5766a6f9f1), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:15.223035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["17cccc67-4e88-4825-bbec-ff584d7d224e","insert","qg-d4dca6ad-03",["set",[]],["map",[["attached-mac","fa:16:3e:73:4a:1e"],["iface-id","d4dca6ad-037a-430a-80c1-dd62be445e07"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:58:15.236170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["17cccc67-4e88-4825-bbec-ff584d7d224e","old",null,["set",[]],null],["","new","qg-d4dca6ad-03",29,["map",[["attached-mac","fa:16:3e:73:4a:1e"],["iface-id","d4dca6ad-037a-430a-80c1-dd62be445e07"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 00:58:15.951780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:322 started Sep 25 00:58:15.955374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df75,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=681000000,duration_sec=658,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:15.956943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:58:15.957528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:322 - starting polling. Elapsed:0.006 Sep 25 00:58:15.961140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:15.967272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:322 - port information retrieved. Elapsed:0.016 Sep 25 00:58:15.967807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '68a3f405-e599-4339-b2a8-058311132e20', '223185f3-b5c4-4c49-9934-15eec28454bf', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', '7d521366-e68f-48bd-a7a8-e2283117a2b7', 'ce1017e5-9b95-4c64-a292-cd0bafd98099', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2', '312a0875-9d08-4c94-b6f3-3135500afa6a', 'd4dca6ad-037a-430a-80c1-dd62be445e07', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '4a688d1f-1335-463f-b319-bcba153c442f', '1b8115fa-df9f-4b13-830a-866086f1b68f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'c41e83db-31a6-4fd6-a328-2ef3b504c9c3', '078c0e3b-64fa-4b32-9903-3d2ac504d9d4', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'de4727a2-569d-44c6-a53e-ecc89817f610'}, 'added': {'223185f3-b5c4-4c49-9934-15eec28454bf', 'd4dca6ad-037a-430a-80c1-dd62be445e07'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:58:15.968640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: WARNING neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:58:12Z,data_plane_status=None,description='',device_id='2900192a-2a98-46c6-beef-900d41ac2156',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=223185f3-b5c4-4c49-9934-15eec28454bf,mac_address=fa:16:3e:50:42:1d,name='',network_id=305a606b-4752-46cc-b1fb-85da780b88ce,numa_affinity_policy=,project_id='31719d4e28f048bbbf6e307df745e648',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(223185f3-b5c4-4c49-9934-15eec28454bf),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T00:58:13Z) is not bound. Sep 25 00:58:15.969388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': 'd4dca6ad-037a-430a-80c1-dd62be445e07', 'device_id': '2900192a-2a98-46c6-beef-900d41ac2156', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': 'd4dca6ad-037a-430a-80c1-dd62be445e07', 'mac_address': 'fa:16:3e:73:4a:1e', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.164'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:58:15.977941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 223185f3-b5c4-4c49-9934-15eec28454bf {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:58:15.978478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Device 223185f3-b5c4-4c49-9934-15eec28454bf not defined on plugin or binding failed Sep 25 00:58:15.979197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: d4dca6ad-037a-430a-80c1-dd62be445e07 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:58:15.980562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port d4dca6ad-037a-430a-80c1-dd62be445e07 updated. Details: {'device': 'd4dca6ad-037a-430a-80c1-dd62be445e07', 'device_id': '2900192a-2a98-46c6-beef-900d41ac2156', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': 'd4dca6ad-037a-430a-80c1-dd62be445e07', 'mac_address': 'fa:16:3e:73:4a:1e', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.164'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 25 00:58:15.985965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-d4dca6ad-03, col_values=(('tag', 2),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:15.986697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-d4dca6ad-03, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:15.988275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-d4dca6ad-03, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:16.004827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-d4dca6ad-03, col_values=(('other_config', {'net_uuid': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:16.021478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834df77,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 29}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:16.022350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:322 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 25 devices currently available. Time elapsed: 0.054 Sep 25 00:58:16.022857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing device filters for 2 new devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 25 00:58:16.023602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing filters for devices {'223185f3-b5c4-4c49-9934-15eec28454bf', 'd4dca6ad-037a-430a-80c1-dd62be445e07'} Sep 25 00:58:16.025187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:58:16.025499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:58:16.031613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:58:16.145427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0e9ea2-bece-49b4-9e5e-d0c70dd63ee4]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:58:16.146374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:322 - agent port security group processed in 0.178 Sep 25 00:58:16.149130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for d4dca6ad-037a-430a-80c1-dd62be445e07 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:58:16.496255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['d4dca6ad-037a-430a-80c1-dd62be445e07'] and devices down [] completed. Sep 25 00:58:16.496873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:322 - ports processed. Elapsed:0.545 Sep 25 00:58:16.497597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:322 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 0, 'removed': 0}}. Elapsed:0.546 Sep 25 00:58:16.593981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Resource Port d4dca6ad-037a-430a-80c1-dd62be445e07 updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=d4dca6ad-037a-430a-80c1-dd62be445e07,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=d4dca6ad-037a-430a-80c1-dd62be445e07,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)], 'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:16.597017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (d4dca6ad-037a-430a-80c1-dd62be445e07), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:17.953809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:323 started Sep 25 00:58:17.959657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df79,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=684000000,duration_sec=660,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:17.960696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:58:17.962257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:323 - starting polling. Elapsed:0.009 Sep 25 00:58:17.971305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:18.002982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:323 - port information retrieved. Elapsed:0.050 Sep 25 00:58:18.003357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '68a3f405-e599-4339-b2a8-058311132e20', '223185f3-b5c4-4c49-9934-15eec28454bf', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', '7d521366-e68f-48bd-a7a8-e2283117a2b7', 'ce1017e5-9b95-4c64-a292-cd0bafd98099', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2', '312a0875-9d08-4c94-b6f3-3135500afa6a', 'd4dca6ad-037a-430a-80c1-dd62be445e07', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '4a688d1f-1335-463f-b319-bcba153c442f', '1b8115fa-df9f-4b13-830a-866086f1b68f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'c41e83db-31a6-4fd6-a328-2ef3b504c9c3', '078c0e3b-64fa-4b32-9903-3d2ac504d9d4', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'de4727a2-569d-44c6-a53e-ecc89817f610'}, 'added': set(), 'removed': set(), 'updated': {'d4dca6ad-037a-430a-80c1-dd62be445e07'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:58:18.004341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': 'd4dca6ad-037a-430a-80c1-dd62be445e07', 'device_id': '2900192a-2a98-46c6-beef-900d41ac2156', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': 'd4dca6ad-037a-430a-80c1-dd62be445e07', 'mac_address': 'fa:16:3e:73:4a:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.164'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:58:18.009026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: d4dca6ad-037a-430a-80c1-dd62be445e07 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:58:18.021470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port d4dca6ad-037a-430a-80c1-dd62be445e07 updated. Details: {'device': 'd4dca6ad-037a-430a-80c1-dd62be445e07', 'device_id': '2900192a-2a98-46c6-beef-900d41ac2156', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': 'd4dca6ad-037a-430a-80c1-dd62be445e07', 'mac_address': 'fa:16:3e:73:4a:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.164'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 25 00:58:18.022695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-d4dca6ad-03, col_values=(('tag', 2),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:18.023278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-d4dca6ad-03, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:18.023638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-d4dca6ad-03, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:18.024102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:58:18.025044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-d4dca6ad-03, col_values=(('other_config', {'net_uuid': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:18.025830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 00:58:18.031757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834df7b,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 29}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:18.032461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:323 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 25 devices currently available. Time elapsed: 0.029 Sep 25 00:58:18.033014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refreshing firewall for 1 devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 25 00:58:18.038335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refresh firewall rules Sep 25 00:58:18.040660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:58:18.041396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:58:18.048760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:58:18.151235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff4663b-1b88-474d-95ca-c4dac7e5aaea]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:58:18.153705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:323 - agent port security group processed in 0.148 Sep 25 00:58:18.155437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for d4dca6ad-037a-430a-80c1-dd62be445e07 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:58:18.605699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['d4dca6ad-037a-430a-80c1-dd62be445e07'] and devices down [] completed. Sep 25 00:58:18.605935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:323 - ports processed. Elapsed:0.653 Sep 25 00:58:18.607145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:323 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.654 Sep 25 00:58:18.980015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0eb9d29c-139b-4230-9079-4e4cfc7e099c tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:58:17Z,data_plane_status=None,description='',device_id='6892e391-59db-43ba-8843-ce34ade53390',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=36da5046-389c-4afa-9d14-41833f5b0db3,mac_address=fa:16:3e:5a:2e:f6,name='',network_id=5dc49b54-686c-4619-ad4c-65c72c26fd31,numa_affinity_policy=,project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(36da5046-389c-4afa-9d14-41833f5b0db3),security_group_ids=set([f0d3b914-378e-40fe-b150-c8676dc91021]),status='DOWN',updated_at=2022-09-25T00:58:17Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:18.981507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0eb9d29c-139b-4230-9079-4e4cfc7e099c tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (36da5046-389c-4afa-9d14-41833f5b0db3), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:18.982411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-0eb9d29c-139b-4230-9079-4e4cfc7e099c tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group member updated {'f0d3b914-378e-40fe-b150-c8676dc91021'} Sep 25 00:58:19.738310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-885fc8aa-f15e-4965-ad6a-54ea42dab7db tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:58:18Z,data_plane_status=None,description='',device_id='63e5af09-dbe0-471f-a5bd-9519f11c8d70',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=2d8c367e-4bc1-45e8-8730-7a0f3f231689,mac_address=fa:16:3e:3f:86:35,name='',network_id=31fa7821-6345-4f48-b070-9ceab6d12adf,numa_affinity_policy=,project_id='46f19fd9ad1e4880961d1eee75883687',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(2d8c367e-4bc1-45e8-8730-7a0f3f231689),security_group_ids=set([0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c]),status='DOWN',updated_at=2022-09-25T00:58:18Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:19.739185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-885fc8aa-f15e-4965-ad6a-54ea42dab7db tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (2d8c367e-4bc1-45e8-8730-7a0f3f231689), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:19.739750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-885fc8aa-f15e-4965-ad6a-54ea42dab7db tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Security group member updated {'0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c'} Sep 25 00:58:19.955067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:324 started Sep 25 00:58:19.960092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df7d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=685000000,duration_sec=662,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:19.961799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:58:19.962338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:324 - starting polling. Elapsed:0.007 Sep 25 00:58:19.966530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:19.977634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:324 - port information retrieved. Elapsed:0.023 Sep 25 00:58:19.980885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:324 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.026 Sep 25 00:58:20.394593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5182068c-d98e-49af-bcec-f458e5e6bb83 None None] Resource Port 223185f3-b5c4-4c49-9934-15eec28454bf updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=223185f3-b5c4-4c49-9934-15eec28454bf,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=223185f3-b5c4-4c49-9934-15eec28454bf,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:20.395265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5182068c-d98e-49af-bcec-f458e5e6bb83 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (223185f3-b5c4-4c49-9934-15eec28454bf), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:20.732673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e35bfb73-f724-4b6a-ba48-4ced8aac4cb7 service neutron] Resource Port 36da5046-389c-4afa-9d14-41833f5b0db3 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=36da5046-389c-4afa-9d14-41833f5b0db3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=36da5046-389c-4afa-9d14-41833f5b0db3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:20.735178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e35bfb73-f724-4b6a-ba48-4ced8aac4cb7 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (36da5046-389c-4afa-9d14-41833f5b0db3), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:20.905646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5182068c-d98e-49af-bcec-f458e5e6bb83 None None] Resource Port 223185f3-b5c4-4c49-9934-15eec28454bf updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=223185f3-b5c4-4c49-9934-15eec28454bf,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=223185f3-b5c4-4c49-9934-15eec28454bf,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=223185f3-b5c4-4c49-9934-15eec28454bf,segment=NetworkSegment(7a66e3b5-b3f5-43ff-ae94-f02bf2a9360f),segment_id=7a66e3b5-b3f5-43ff-ae94-f02bf2a9360f)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:20.906313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5182068c-d98e-49af-bcec-f458e5e6bb83 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (223185f3-b5c4-4c49-9934-15eec28454bf), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:21.298781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e35bfb73-f724-4b6a-ba48-4ced8aac4cb7 service neutron] Resource Port 36da5046-389c-4afa-9d14-41833f5b0db3 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=36da5046-389c-4afa-9d14-41833f5b0db3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=36da5046-389c-4afa-9d14-41833f5b0db3,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=36da5046-389c-4afa-9d14-41833f5b0db3,segment=NetworkSegment(32553459-8243-41b9-9fc0-bae9f5646e9f),segment_id=32553459-8243-41b9-9fc0-bae9f5646e9f)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:21.300149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e35bfb73-f724-4b6a-ba48-4ced8aac4cb7 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (36da5046-389c-4afa-9d14-41833f5b0db3), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:21.353595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f28e6c79-6cf0-432d-a79b-4253f6f48487 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:58:20Z,data_plane_status=None,description='',device_id='621dfc45-048c-452f-86ca-ffdaeeb5f919',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=a554103e-40f9-42b8-b04a-4fc7d8888240,mac_address=fa:16:3e:a1:d4:ab,name='',network_id=e04e78f2-fc42-4b3e-9ba5-62cef58448f8,numa_affinity_policy=,project_id='28568584195d475fbc52d76185e09044',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(a554103e-40f9-42b8-b04a-4fc7d8888240),security_group_ids=set([eeea7474-c761-4d5f-be6e-c79f9aedf9b8]),status='DOWN',updated_at=2022-09-25T00:58:20Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:21.354310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f28e6c79-6cf0-432d-a79b-4253f6f48487 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (a554103e-40f9-42b8-b04a-4fc7d8888240), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:21.355014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f28e6c79-6cf0-432d-a79b-4253f6f48487 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Security group member updated {'eeea7474-c761-4d5f-be6e-c79f9aedf9b8'} Sep 25 00:58:21.957016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:325 started Sep 25 00:58:21.982241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ea43a11e-64fa-4630-b5ba-e156009bbd07 None None] Resource Port 223185f3-b5c4-4c49-9934-15eec28454bf updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:21.983000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ea43a11e-64fa-4630-b5ba-e156009bbd07 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (223185f3-b5c4-4c49-9934-15eec28454bf), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:21.995538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df7f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=715000000,duration_sec=664,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:21.998431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:58:21.998974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:325 - starting polling. Elapsed:0.042 Sep 25 00:58:22.007698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:22.014347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:325 - port information retrieved. Elapsed:0.057 Sep 25 00:58:22.014956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '68a3f405-e599-4339-b2a8-058311132e20', '223185f3-b5c4-4c49-9934-15eec28454bf', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', '7d521366-e68f-48bd-a7a8-e2283117a2b7', 'ce1017e5-9b95-4c64-a292-cd0bafd98099', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2', '312a0875-9d08-4c94-b6f3-3135500afa6a', 'd4dca6ad-037a-430a-80c1-dd62be445e07', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '4a688d1f-1335-463f-b319-bcba153c442f', '1b8115fa-df9f-4b13-830a-866086f1b68f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'c41e83db-31a6-4fd6-a328-2ef3b504c9c3', '078c0e3b-64fa-4b32-9903-3d2ac504d9d4', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'de4727a2-569d-44c6-a53e-ecc89817f610'}, 'added': set(), 'removed': set(), 'updated': {'223185f3-b5c4-4c49-9934-15eec28454bf'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 00:58:22.016783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '223185f3-b5c4-4c49-9934-15eec28454bf', 'device_id': '2900192a-2a98-46c6-beef-900d41ac2156', 'network_id': '305a606b-4752-46cc-b1fb-85da780b88ce', 'port_id': '223185f3-b5c4-4c49-9934-15eec28454bf', 'mac_address': 'fa:16:3e:50:42:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 78, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '4f943db5-728a-408e-91ba-0a8afa5e45da', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 00:58:22.025681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 223185f3-b5c4-4c49-9934-15eec28454bf {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 00:58:22.026509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 223185f3-b5c4-4c49-9934-15eec28454bf updated. Details: {'device': '223185f3-b5c4-4c49-9934-15eec28454bf', 'device_id': '2900192a-2a98-46c6-beef-900d41ac2156', 'network_id': '305a606b-4752-46cc-b1fb-85da780b88ce', 'port_id': '223185f3-b5c4-4c49-9934-15eec28454bf', 'mac_address': 'fa:16:3e:50:42:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 78, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '4f943db5-728a-408e-91ba-0a8afa5e45da', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 11} Sep 25 00:58:22.028861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-223185f3-b5, col_values=(('tag', 11),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:22.029534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-223185f3-b5, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:22.030374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-223185f3-b5, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:22.047402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7d36c134-3219-4449-a944-b26018a4bf2b service neutron] Resource Port 2d8c367e-4bc1-45e8-8730-7a0f3f231689 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=2d8c367e-4bc1-45e8-8730-7a0f3f231689,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=2d8c367e-4bc1-45e8-8730-7a0f3f231689,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:22.048404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7d36c134-3219-4449-a944-b26018a4bf2b service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (2d8c367e-4bc1-45e8-8730-7a0f3f231689), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:22.053308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-223185f3-b5, col_values=(('other_config', {'net_uuid': '305a606b-4752-46cc-b1fb-85da780b88ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '11', 'segmentation_id': '78'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 00:58:22.076590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834df81,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 28}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:22.077596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:325 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 25 devices currently available. Time elapsed: 0.062 Sep 25 00:58:22.078678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refreshing firewall for 1 devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 25 00:58:22.079653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refresh firewall rules Sep 25 00:58:22.081683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 00:58:22.082346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 00:58:22.090773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 00:58:22.204757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a540ed3f-e00e-4821-bb3d-859ef891194a]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 00:58:22.206641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:325 - agent port security group processed in 0.191 Sep 25 00:58:22.208072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 223185f3-b5c4-4c49-9934-15eec28454bf to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 00:58:22.720756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['223185f3-b5c4-4c49-9934-15eec28454bf'] and devices down [] completed. Sep 25 00:58:22.722138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:325 - ports processed. Elapsed:0.765 Sep 25 00:58:22.722631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:325 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.766 Sep 25 00:58:23.212746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7d36c134-3219-4449-a944-b26018a4bf2b service neutron] Resource Port 2d8c367e-4bc1-45e8-8730-7a0f3f231689 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=2d8c367e-4bc1-45e8-8730-7a0f3f231689,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=2d8c367e-4bc1-45e8-8730-7a0f3f231689,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=2d8c367e-4bc1-45e8-8730-7a0f3f231689,segment=NetworkSegment(5580d2ab-1c02-4162-bded-4b179649cc54),segment_id=5580d2ab-1c02-4162-bded-4b179649cc54)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:23.213600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7d36c134-3219-4449-a944-b26018a4bf2b service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (2d8c367e-4bc1-45e8-8730-7a0f3f231689), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:23.447276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e320bf86-167c-49bb-ab8d-c12069e56521 service neutron] Resource Port a554103e-40f9-42b8-b04a-4fc7d8888240 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=a554103e-40f9-42b8-b04a-4fc7d8888240,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=a554103e-40f9-42b8-b04a-4fc7d8888240,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:23.447787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e320bf86-167c-49bb-ab8d-c12069e56521 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (a554103e-40f9-42b8-b04a-4fc7d8888240), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:23.816309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e320bf86-167c-49bb-ab8d-c12069e56521 service neutron] Resource Port a554103e-40f9-42b8-b04a-4fc7d8888240 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=a554103e-40f9-42b8-b04a-4fc7d8888240,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=a554103e-40f9-42b8-b04a-4fc7d8888240,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=a554103e-40f9-42b8-b04a-4fc7d8888240,segment=NetworkSegment(6dee2139-73a3-4d84-b994-05c9c1e85f42),segment_id=6dee2139-73a3-4d84-b994-05c9c1e85f42)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:23.817706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e320bf86-167c-49bb-ab8d-c12069e56521 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (a554103e-40f9-42b8-b04a-4fc7d8888240), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:23.958501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:326 started Sep 25 00:58:23.961441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df83,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=687000000,duration_sec=666,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:23.962245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:58:23.962820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:326 - starting polling. Elapsed:0.004 Sep 25 00:58:23.966358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:23.978891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:326 - port information retrieved. Elapsed:0.020 Sep 25 00:58:23.979470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:326 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.021 Sep 25 00:58:25.961098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:327 started Sep 25 00:58:25.966845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df85,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=690000000,duration_sec=668,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:25.969042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:58:25.969715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:327 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 25 00:58:27.962445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:328 started Sep 25 00:58:27.965464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df87,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=691000000,duration_sec=670,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:27.966284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:58:27.966633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:328 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:58:28.131824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 36da5046-389c-4afa-9d14-41833f5b0db3 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:28.132219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (36da5046-389c-4afa-9d14-41833f5b0db3), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:29.963387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:329 started Sep 25 00:58:29.967967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df89,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=693000000,duration_sec=672,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:29.968887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:58:29.969371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:329 - starting polling. Elapsed:0.006 Sep 25 00:58:29.973526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:29.983723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:329 - port information retrieved. Elapsed:0.020 Sep 25 00:58:29.984219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:329 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.021 Sep 25 00:58:30.250096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 96168749-3e0f-462f-9aed-adacd4fb28c0 updated (revision_number 5->6). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'BUILD'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:30.250799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (96168749-3e0f-462f-9aed-adacd4fb28c0), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:30.323684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 36da5046-389c-4afa-9d14-41833f5b0db3 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:30.324076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (36da5046-389c-4afa-9d14-41833f5b0db3), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:31.302245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-885e3ef7-2e62-4e46-96ca-a82263ba20ed admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:58:31Z,description='Default security group',id=240d7b2b-1c70-4900-b812-ac3fa3a35152,is_default=True,name='default',project_id='3880cc1b631a4426adc5cae65932049d',revision_number=1,rules=[SecurityGroupRule(1d6f1669-3ce3-4533-897c-6667507d22d7),SecurityGroupRule(49ac0d5f-1083-4482-b721-5ebf4833f169),SecurityGroupRule(4dd0347c-e59d-4ddc-b3f7-61488d77ef9c),SecurityGroupRule(fb19d7ba-ad4a-40bd-adde-a56b17ebe1c6)],shared=False,stateful=True,updated_at=2022-09-25T00:58:31Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:31.302896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-885e3ef7-2e62-4e46-96ca-a82263ba20ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (240d7b2b-1c70-4900-b812-ac3fa3a35152), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:31.303239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-885e3ef7-2e62-4e46-96ca-a82263ba20ed admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:31Z,description=,direction='ingress',ethertype='IPv4',id=1d6f1669-3ce3-4533-897c-6667507d22d7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3880cc1b631a4426adc5cae65932049d',protocol=,remote_address_group_id=,remote_group_id=240d7b2b-1c70-4900-b812-ac3fa3a35152,remote_ip_prefix=,revision_number=0,security_group_id=240d7b2b-1c70-4900-b812-ac3fa3a35152,updated_at=2022-09-25T00:58:31Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:31.304223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-885e3ef7-2e62-4e46-96ca-a82263ba20ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (1d6f1669-3ce3-4533-897c-6667507d22d7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:31.304782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-885e3ef7-2e62-4e46-96ca-a82263ba20ed admin admin] Security group rule updated ['240d7b2b-1c70-4900-b812-ac3fa3a35152'] Sep 25 00:58:31.305735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-885e3ef7-2e62-4e46-96ca-a82263ba20ed admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:31Z,description=,direction='ingress',ethertype='IPv6',id=49ac0d5f-1083-4482-b721-5ebf4833f169,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3880cc1b631a4426adc5cae65932049d',protocol=,remote_address_group_id=,remote_group_id=240d7b2b-1c70-4900-b812-ac3fa3a35152,remote_ip_prefix=,revision_number=0,security_group_id=240d7b2b-1c70-4900-b812-ac3fa3a35152,updated_at=2022-09-25T00:58:31Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:31.306402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-885e3ef7-2e62-4e46-96ca-a82263ba20ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (49ac0d5f-1083-4482-b721-5ebf4833f169), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:31.306925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-885e3ef7-2e62-4e46-96ca-a82263ba20ed admin admin] Security group rule updated ['240d7b2b-1c70-4900-b812-ac3fa3a35152'] Sep 25 00:58:31.308607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-885e3ef7-2e62-4e46-96ca-a82263ba20ed admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:31Z,description=,direction='egress',ethertype='IPv4',id=4dd0347c-e59d-4ddc-b3f7-61488d77ef9c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3880cc1b631a4426adc5cae65932049d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=240d7b2b-1c70-4900-b812-ac3fa3a35152,updated_at=2022-09-25T00:58:31Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:31.309049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-885e3ef7-2e62-4e46-96ca-a82263ba20ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (4dd0347c-e59d-4ddc-b3f7-61488d77ef9c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:31.309592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-885e3ef7-2e62-4e46-96ca-a82263ba20ed admin admin] Security group rule updated ['240d7b2b-1c70-4900-b812-ac3fa3a35152'] Sep 25 00:58:31.311039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-885e3ef7-2e62-4e46-96ca-a82263ba20ed admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:31Z,description=,direction='egress',ethertype='IPv6',id=fb19d7ba-ad4a-40bd-adde-a56b17ebe1c6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3880cc1b631a4426adc5cae65932049d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=240d7b2b-1c70-4900-b812-ac3fa3a35152,updated_at=2022-09-25T00:58:31Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:31.312173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-885e3ef7-2e62-4e46-96ca-a82263ba20ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (fb19d7ba-ad4a-40bd-adde-a56b17ebe1c6), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:31.312706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-885e3ef7-2e62-4e46-96ca-a82263ba20ed admin admin] Security group rule updated ['240d7b2b-1c70-4900-b812-ac3fa3a35152'] Sep 25 00:58:31.535176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c7d03f2b-a2ef-4338-9213-31aefd9b0011 admin admin] Resource SecurityGroup deleted: 240d7b2b-1c70-4900-b812-ac3fa3a35152 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:31.535559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c7d03f2b-a2ef-4338-9213-31aefd9b0011 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (240d7b2b-1c70-4900-b812-ac3fa3a35152), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:31.536028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7d03f2b-a2ef-4338-9213-31aefd9b0011 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('240d7b2b-1c70-4900-b812-ac3fa3a35152',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:58:31.550735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c7d03f2b-a2ef-4338-9213-31aefd9b0011 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('240d7b2b-1c70-4900-b812-ac3fa3a35152',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:58:31.551392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c7d03f2b-a2ef-4338-9213-31aefd9b0011 admin admin] Resource SecurityGroupRule deleted: 1d6f1669-3ce3-4533-897c-6667507d22d7 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:31.551963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c7d03f2b-a2ef-4338-9213-31aefd9b0011 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (1d6f1669-3ce3-4533-897c-6667507d22d7), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:31.552491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c7d03f2b-a2ef-4338-9213-31aefd9b0011 admin admin] Security group rule updated ['240d7b2b-1c70-4900-b812-ac3fa3a35152'] Sep 25 00:58:31.553002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c7d03f2b-a2ef-4338-9213-31aefd9b0011 admin admin] Resource SecurityGroupRule deleted: 49ac0d5f-1083-4482-b721-5ebf4833f169 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:31.554280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c7d03f2b-a2ef-4338-9213-31aefd9b0011 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (49ac0d5f-1083-4482-b721-5ebf4833f169), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:31.554280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c7d03f2b-a2ef-4338-9213-31aefd9b0011 admin admin] Security group rule updated ['240d7b2b-1c70-4900-b812-ac3fa3a35152'] Sep 25 00:58:31.554496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c7d03f2b-a2ef-4338-9213-31aefd9b0011 admin admin] Resource SecurityGroupRule deleted: 4dd0347c-e59d-4ddc-b3f7-61488d77ef9c {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:31.554850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c7d03f2b-a2ef-4338-9213-31aefd9b0011 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (4dd0347c-e59d-4ddc-b3f7-61488d77ef9c), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:31.555174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c7d03f2b-a2ef-4338-9213-31aefd9b0011 admin admin] Security group rule updated ['240d7b2b-1c70-4900-b812-ac3fa3a35152'] Sep 25 00:58:31.555549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c7d03f2b-a2ef-4338-9213-31aefd9b0011 admin admin] Resource SecurityGroupRule deleted: fb19d7ba-ad4a-40bd-adde-a56b17ebe1c6 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:31.555888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c7d03f2b-a2ef-4338-9213-31aefd9b0011 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (fb19d7ba-ad4a-40bd-adde-a56b17ebe1c6), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:31.556210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c7d03f2b-a2ef-4338-9213-31aefd9b0011 admin admin] Security group rule updated ['240d7b2b-1c70-4900-b812-ac3fa3a35152'] Sep 25 00:58:31.964839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:330 started Sep 25 00:58:31.967281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df8b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=693000000,duration_sec=674,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:31.968040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:58:31.968521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:330 - starting polling. Elapsed:0.004 Sep 25 00:58:31.973004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:31.980772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:330 - port information retrieved. Elapsed:0.016 Sep 25 00:58:31.981347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:330 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Sep 25 00:58:31.988025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 96168749-3e0f-462f-9aed-adacd4fb28c0 updated (revision_number 6->7). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:31.988609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (96168749-3e0f-462f-9aed-adacd4fb28c0), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:32.214112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-797da0fb-4a23-4732-a986-d5480bc163fd admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:58:32Z,description='Default security group',id=139db32a-50b3-4845-a849-48a0e4423db0,is_default=True,name='default',project_id='be6239167c474888803de4aa4039c40e',revision_number=1,rules=[SecurityGroupRule(923235c1-72ce-4e25-8858-a9f96d28800f),SecurityGroupRule(b37f79ad-0364-4740-9c23-5a25634c5bb7),SecurityGroupRule(bae7c294-476d-460a-a2e0-89a01195bf01),SecurityGroupRule(f954e9b1-2829-41d1-a29e-c0816178ba39)],shared=False,stateful=True,updated_at=2022-09-25T00:58:32Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:32.214495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-797da0fb-4a23-4732-a986-d5480bc163fd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (139db32a-50b3-4845-a849-48a0e4423db0), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:32.215159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-797da0fb-4a23-4732-a986-d5480bc163fd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:32Z,description=,direction='ingress',ethertype='IPv4',id=923235c1-72ce-4e25-8858-a9f96d28800f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='be6239167c474888803de4aa4039c40e',protocol=,remote_address_group_id=,remote_group_id=139db32a-50b3-4845-a849-48a0e4423db0,remote_ip_prefix=,revision_number=0,security_group_id=139db32a-50b3-4845-a849-48a0e4423db0,updated_at=2022-09-25T00:58:32Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:32.215523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-797da0fb-4a23-4732-a986-d5480bc163fd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (923235c1-72ce-4e25-8858-a9f96d28800f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:32.215920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-797da0fb-4a23-4732-a986-d5480bc163fd admin admin] Security group rule updated ['139db32a-50b3-4845-a849-48a0e4423db0'] Sep 25 00:58:32.216635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-797da0fb-4a23-4732-a986-d5480bc163fd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:32Z,description=,direction='egress',ethertype='IPv4',id=b37f79ad-0364-4740-9c23-5a25634c5bb7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='be6239167c474888803de4aa4039c40e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=139db32a-50b3-4845-a849-48a0e4423db0,updated_at=2022-09-25T00:58:32Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:32.217051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-797da0fb-4a23-4732-a986-d5480bc163fd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (b37f79ad-0364-4740-9c23-5a25634c5bb7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:32.217348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-797da0fb-4a23-4732-a986-d5480bc163fd admin admin] Security group rule updated ['139db32a-50b3-4845-a849-48a0e4423db0'] Sep 25 00:58:32.218214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-797da0fb-4a23-4732-a986-d5480bc163fd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:32Z,description=,direction='ingress',ethertype='IPv6',id=bae7c294-476d-460a-a2e0-89a01195bf01,normalized_cidr=None,port_range_max=,port_range_min=,project_id='be6239167c474888803de4aa4039c40e',protocol=,remote_address_group_id=,remote_group_id=139db32a-50b3-4845-a849-48a0e4423db0,remote_ip_prefix=,revision_number=0,security_group_id=139db32a-50b3-4845-a849-48a0e4423db0,updated_at=2022-09-25T00:58:32Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:32.218863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-797da0fb-4a23-4732-a986-d5480bc163fd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (bae7c294-476d-460a-a2e0-89a01195bf01), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:32.219595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-797da0fb-4a23-4732-a986-d5480bc163fd admin admin] Security group rule updated ['139db32a-50b3-4845-a849-48a0e4423db0'] Sep 25 00:58:32.221521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-797da0fb-4a23-4732-a986-d5480bc163fd admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:32Z,description=,direction='egress',ethertype='IPv6',id=f954e9b1-2829-41d1-a29e-c0816178ba39,normalized_cidr=None,port_range_max=,port_range_min=,project_id='be6239167c474888803de4aa4039c40e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=139db32a-50b3-4845-a849-48a0e4423db0,updated_at=2022-09-25T00:58:32Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:32.222089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-797da0fb-4a23-4732-a986-d5480bc163fd admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f954e9b1-2829-41d1-a29e-c0816178ba39), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:32.222908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-797da0fb-4a23-4732-a986-d5480bc163fd admin admin] Security group rule updated ['139db32a-50b3-4845-a849-48a0e4423db0'] Sep 25 00:58:32.433357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-144dc316-7cab-42b9-918b-dec13c2bf087 admin admin] Resource SecurityGroup deleted: 139db32a-50b3-4845-a849-48a0e4423db0 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:32.434401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-144dc316-7cab-42b9-918b-dec13c2bf087 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (139db32a-50b3-4845-a849-48a0e4423db0), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:32.435022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-144dc316-7cab-42b9-918b-dec13c2bf087 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('139db32a-50b3-4845-a849-48a0e4423db0',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:58:32.455755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-144dc316-7cab-42b9-918b-dec13c2bf087 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('139db32a-50b3-4845-a849-48a0e4423db0',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:58:32.456524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-144dc316-7cab-42b9-918b-dec13c2bf087 admin admin] Resource SecurityGroupRule deleted: 923235c1-72ce-4e25-8858-a9f96d28800f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:32.456938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-144dc316-7cab-42b9-918b-dec13c2bf087 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (923235c1-72ce-4e25-8858-a9f96d28800f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:32.457478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-144dc316-7cab-42b9-918b-dec13c2bf087 admin admin] Security group rule updated ['139db32a-50b3-4845-a849-48a0e4423db0'] Sep 25 00:58:32.457888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-144dc316-7cab-42b9-918b-dec13c2bf087 admin admin] Resource SecurityGroupRule deleted: b37f79ad-0364-4740-9c23-5a25634c5bb7 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:32.458249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-144dc316-7cab-42b9-918b-dec13c2bf087 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (b37f79ad-0364-4740-9c23-5a25634c5bb7), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:32.458872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-144dc316-7cab-42b9-918b-dec13c2bf087 admin admin] Security group rule updated ['139db32a-50b3-4845-a849-48a0e4423db0'] Sep 25 00:58:32.459260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-144dc316-7cab-42b9-918b-dec13c2bf087 admin admin] Resource SecurityGroupRule deleted: bae7c294-476d-460a-a2e0-89a01195bf01 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:32.459641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-144dc316-7cab-42b9-918b-dec13c2bf087 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (bae7c294-476d-460a-a2e0-89a01195bf01), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:32.459962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-144dc316-7cab-42b9-918b-dec13c2bf087 admin admin] Security group rule updated ['139db32a-50b3-4845-a849-48a0e4423db0'] Sep 25 00:58:32.460344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-144dc316-7cab-42b9-918b-dec13c2bf087 admin admin] Resource SecurityGroupRule deleted: f954e9b1-2829-41d1-a29e-c0816178ba39 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:32.460717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-144dc316-7cab-42b9-918b-dec13c2bf087 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f954e9b1-2829-41d1-a29e-c0816178ba39), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:32.461538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-144dc316-7cab-42b9-918b-dec13c2bf087 admin admin] Security group rule updated ['139db32a-50b3-4845-a849-48a0e4423db0'] Sep 25 00:58:33.966438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:331 started Sep 25 00:58:33.969053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df8d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=695000000,duration_sec=676,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:33.969772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:58:33.970368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:331 - starting polling. Elapsed:0.004 Sep 25 00:58:33.974026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:34.001592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:331 - port information retrieved. Elapsed:0.031 Sep 25 00:58:34.003643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:331 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.037 Sep 25 00:58:34.147733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port a554103e-40f9-42b8-b04a-4fc7d8888240 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:34.149042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (a554103e-40f9-42b8-b04a-4fc7d8888240), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:35.968016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:332 started Sep 25 00:58:35.972211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df8f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=697000000,duration_sec=678,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:35.973427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:58:35.973927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:332 - starting polling. Elapsed:0.006 Sep 25 00:58:35.978696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:35.994599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:332 - port information retrieved. Elapsed:0.026 Sep 25 00:58:36.004892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:332 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.035 Sep 25 00:58:37.072873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-49da29f4-4a41-4b5d-9105-de6a7a5c080a tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:58:35Z,data_plane_status=None,description='',device_id='27675569-1b42-49db-a883-3ad6e55fc75d',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=0940e2bc-bbba-4cec-82c5-38b72d995723,mac_address=fa:16:3e:fa:fc:82,name='',network_id=f9e440d6-f48e-45bb-9a01-3ccd9ccf9488,numa_affinity_policy=,project_id='b161c2e2dd1f42159dc0d71e8216516c',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(0940e2bc-bbba-4cec-82c5-38b72d995723),security_group_ids=set([5820ec3a-8d2a-47c6-8b82-59a1dad211f3]),status='DOWN',updated_at=2022-09-25T00:58:35Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:37.073971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-49da29f4-4a41-4b5d-9105-de6a7a5c080a tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (0940e2bc-bbba-4cec-82c5-38b72d995723), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:37.073971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-49da29f4-4a41-4b5d-9105-de6a7a5c080a tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Security group member updated {'5820ec3a-8d2a-47c6-8b82-59a1dad211f3'} Sep 25 00:58:37.352869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port a554103e-40f9-42b8-b04a-4fc7d8888240 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:37.353303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (a554103e-40f9-42b8-b04a-4fc7d8888240), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:37.971804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:333 started Sep 25 00:58:37.975175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df91,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=701000000,duration_sec=680,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:37.976103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:58:37.976598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:333 - starting polling. Elapsed:0.005 Sep 25 00:58:37.981274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:37.998854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:333 - port information retrieved. Elapsed:0.025 Sep 25 00:58:38.000399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:333 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.029 Sep 25 00:58:38.667429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c388a7b5-c1b8-4cef-8249-4c0ddc804111 service neutron] Resource Port 0940e2bc-bbba-4cec-82c5-38b72d995723 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=0940e2bc-bbba-4cec-82c5-38b72d995723,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=0940e2bc-bbba-4cec-82c5-38b72d995723,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:38.669001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c388a7b5-c1b8-4cef-8249-4c0ddc804111 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (0940e2bc-bbba-4cec-82c5-38b72d995723), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:39.167706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 2d8c367e-4bc1-45e8-8730-7a0f3f231689 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:39.169572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (2d8c367e-4bc1-45e8-8730-7a0f3f231689), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:39.429631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c388a7b5-c1b8-4cef-8249-4c0ddc804111 service neutron] Resource Port 0940e2bc-bbba-4cec-82c5-38b72d995723 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=0940e2bc-bbba-4cec-82c5-38b72d995723,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=0940e2bc-bbba-4cec-82c5-38b72d995723,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=0940e2bc-bbba-4cec-82c5-38b72d995723,segment=NetworkSegment(d3b4c62f-808e-4358-bc7d-2cd03571d715),segment_id=d3b4c62f-808e-4358-bc7d-2cd03571d715)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:39.430317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c388a7b5-c1b8-4cef-8249-4c0ddc804111 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (0940e2bc-bbba-4cec-82c5-38b72d995723), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:39.987398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:334 started Sep 25 00:58:39.987398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df93,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=701000000,duration_sec=682,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:39.987398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:58:39.987398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:334 - starting polling. Elapsed:0.005 Sep 25 00:58:39.988273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:39.992220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:334 - port information retrieved. Elapsed:0.019 Sep 25 00:58:39.993460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:334 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.021 Sep 25 00:58:41.973132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:335 started Sep 25 00:58:41.977707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df95,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=703000000,duration_sec=684,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:41.979222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:58:41.979806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:335 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 00:58:42.934287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 2d8c367e-4bc1-45e8-8730-7a0f3f231689 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:42.935127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (2d8c367e-4bc1-45e8-8730-7a0f3f231689), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:43.974636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:336 started Sep 25 00:58:43.990161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df97,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=711000000,duration_sec=686,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:43.997569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:58:43.998222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:336 - starting polling. Elapsed:0.024 Sep 25 00:58:44.005286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:44.034398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:336 - port information retrieved. Elapsed:0.060 Sep 25 00:58:44.037853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:336 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.063 Sep 25 00:58:45.976393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:337 started Sep 25 00:58:45.981718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df99,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=707000000,duration_sec=688,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:45.982616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:58:45.983039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:337 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 00:58:47.977966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:338 started Sep 25 00:58:47.984569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df9b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=709000000,duration_sec=690,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:47.986355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:58:47.987439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:338 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 25 00:58:49.439592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-099a2e12-189e-4a25-8522-b74d168c0716 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:58:49Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=e2bc3cd9-0fce-4cc1-8449-ae53d35f069f,mac_address=fa:16:3e:a0:ab:9b,name='',network_id=62195cd6-54fa-4e24-9d47-ae0de6356ac2,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(e2bc3cd9-0fce-4cc1-8449-ae53d35f069f),security_group_ids=set([]),status='N/A',updated_at=2022-09-25T00:58:49Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:49.440303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-099a2e12-189e-4a25-8522-b74d168c0716 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (e2bc3cd9-0fce-4cc1-8449-ae53d35f069f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:49.979258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:339 started Sep 25 00:58:49.994957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df9d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=709000000,duration_sec=692,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:49.998241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:58:50.002379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:339 - starting polling. Elapsed:0.022 Sep 25 00:58:50.010650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:50.021617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:339 - port information retrieved. Elapsed:0.042 Sep 25 00:58:50.022258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:339 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.043 Sep 25 00:58:50.438312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-099a2e12-189e-4a25-8522-b74d168c0716 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Resource Port e2bc3cd9-0fce-4cc1-8449-ae53d35f069f updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '45d576d5-5d51-4c3f-a36f-d777793489c6'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:50.439217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-099a2e12-189e-4a25-8522-b74d168c0716 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (e2bc3cd9-0fce-4cc1-8449-ae53d35f069f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:51.981291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:340 started Sep 25 00:58:51.983738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834df9f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=710000000,duration_sec=694,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:51.984354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:58:51.984691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:340 - starting polling. Elapsed:0.004 Sep 25 00:58:51.988784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:51.993225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:340 - port information retrieved. Elapsed:0.012 Sep 25 00:58:51.993590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:340 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 25 00:58:53.982582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:341 started Sep 25 00:58:53.985002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfa1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=711000000,duration_sec=696,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:53.986654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:58:53.987309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:341 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:58:54.495455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 0940e2bc-bbba-4cec-82c5-38b72d995723 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:54.497011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (0940e2bc-bbba-4cec-82c5-38b72d995723), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:55.395604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5736a968-339b-463f-85c1-546db150b79f admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:58:55Z,description='Default security group',id=c07a431a-5900-49cd-a4fa-00aea90eac14,is_default=True,name='default',project_id='fe51531385464725be3c70456b493e19',revision_number=1,rules=[SecurityGroupRule(55b9d8ac-1c18-41bf-b268-7ab04bb51a0f),SecurityGroupRule(898f74ad-9aab-4ed9-9bec-f0465ca571d0),SecurityGroupRule(c0f01a02-1b36-4333-84ff-3a9b08215d37),SecurityGroupRule(d242fd8a-2ede-4065-88aa-7f187076d918)],shared=False,stateful=True,updated_at=2022-09-25T00:58:55Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:55.396291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5736a968-339b-463f-85c1-546db150b79f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (c07a431a-5900-49cd-a4fa-00aea90eac14), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:55.396826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5736a968-339b-463f-85c1-546db150b79f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:55Z,description=,direction='ingress',ethertype='IPv4',id=55b9d8ac-1c18-41bf-b268-7ab04bb51a0f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fe51531385464725be3c70456b493e19',protocol=,remote_address_group_id=,remote_group_id=c07a431a-5900-49cd-a4fa-00aea90eac14,remote_ip_prefix=,revision_number=0,security_group_id=c07a431a-5900-49cd-a4fa-00aea90eac14,updated_at=2022-09-25T00:58:55Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:55.397280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5736a968-339b-463f-85c1-546db150b79f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (55b9d8ac-1c18-41bf-b268-7ab04bb51a0f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:55.397752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5736a968-339b-463f-85c1-546db150b79f admin admin] Security group rule updated ['c07a431a-5900-49cd-a4fa-00aea90eac14'] Sep 25 00:58:55.398586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5736a968-339b-463f-85c1-546db150b79f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:55Z,description=,direction='ingress',ethertype='IPv6',id=898f74ad-9aab-4ed9-9bec-f0465ca571d0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fe51531385464725be3c70456b493e19',protocol=,remote_address_group_id=,remote_group_id=c07a431a-5900-49cd-a4fa-00aea90eac14,remote_ip_prefix=,revision_number=0,security_group_id=c07a431a-5900-49cd-a4fa-00aea90eac14,updated_at=2022-09-25T00:58:55Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:55.398958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5736a968-339b-463f-85c1-546db150b79f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (898f74ad-9aab-4ed9-9bec-f0465ca571d0), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:55.399298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5736a968-339b-463f-85c1-546db150b79f admin admin] Security group rule updated ['c07a431a-5900-49cd-a4fa-00aea90eac14'] Sep 25 00:58:55.400204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5736a968-339b-463f-85c1-546db150b79f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:55Z,description=,direction='egress',ethertype='IPv6',id=c0f01a02-1b36-4333-84ff-3a9b08215d37,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fe51531385464725be3c70456b493e19',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c07a431a-5900-49cd-a4fa-00aea90eac14,updated_at=2022-09-25T00:58:55Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:55.400579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5736a968-339b-463f-85c1-546db150b79f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (c0f01a02-1b36-4333-84ff-3a9b08215d37), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:55.400967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5736a968-339b-463f-85c1-546db150b79f admin admin] Security group rule updated ['c07a431a-5900-49cd-a4fa-00aea90eac14'] Sep 25 00:58:55.401700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5736a968-339b-463f-85c1-546db150b79f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:55Z,description=,direction='egress',ethertype='IPv4',id=d242fd8a-2ede-4065-88aa-7f187076d918,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fe51531385464725be3c70456b493e19',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c07a431a-5900-49cd-a4fa-00aea90eac14,updated_at=2022-09-25T00:58:55Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:55.402108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5736a968-339b-463f-85c1-546db150b79f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (d242fd8a-2ede-4065-88aa-7f187076d918), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:55.402483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5736a968-339b-463f-85c1-546db150b79f admin admin] Security group rule updated ['c07a431a-5900-49cd-a4fa-00aea90eac14'] Sep 25 00:58:55.536209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-809561d7-2b67-4811-a96e-09847b41df60 admin admin] Resource SecurityGroup deleted: c07a431a-5900-49cd-a4fa-00aea90eac14 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:55.536592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-809561d7-2b67-4811-a96e-09847b41df60 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (c07a431a-5900-49cd-a4fa-00aea90eac14), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:55.537054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-809561d7-2b67-4811-a96e-09847b41df60 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c07a431a-5900-49cd-a4fa-00aea90eac14',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:58:55.703607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-809561d7-2b67-4811-a96e-09847b41df60 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c07a431a-5900-49cd-a4fa-00aea90eac14',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:58:55.704711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-809561d7-2b67-4811-a96e-09847b41df60 admin admin] Resource SecurityGroupRule deleted: 55b9d8ac-1c18-41bf-b268-7ab04bb51a0f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:55.705128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-809561d7-2b67-4811-a96e-09847b41df60 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (55b9d8ac-1c18-41bf-b268-7ab04bb51a0f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:55.705545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-809561d7-2b67-4811-a96e-09847b41df60 admin admin] Security group rule updated ['c07a431a-5900-49cd-a4fa-00aea90eac14'] Sep 25 00:58:55.705971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-809561d7-2b67-4811-a96e-09847b41df60 admin admin] Resource SecurityGroupRule deleted: 898f74ad-9aab-4ed9-9bec-f0465ca571d0 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:55.706321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-809561d7-2b67-4811-a96e-09847b41df60 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (898f74ad-9aab-4ed9-9bec-f0465ca571d0), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:55.706644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-809561d7-2b67-4811-a96e-09847b41df60 admin admin] Security group rule updated ['c07a431a-5900-49cd-a4fa-00aea90eac14'] Sep 25 00:58:55.707039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-809561d7-2b67-4811-a96e-09847b41df60 admin admin] Resource SecurityGroupRule deleted: c0f01a02-1b36-4333-84ff-3a9b08215d37 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:55.707382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-809561d7-2b67-4811-a96e-09847b41df60 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (c0f01a02-1b36-4333-84ff-3a9b08215d37), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:55.707734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-809561d7-2b67-4811-a96e-09847b41df60 admin admin] Security group rule updated ['c07a431a-5900-49cd-a4fa-00aea90eac14'] Sep 25 00:58:55.708106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-809561d7-2b67-4811-a96e-09847b41df60 admin admin] Resource SecurityGroupRule deleted: d242fd8a-2ede-4065-88aa-7f187076d918 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:55.708444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-809561d7-2b67-4811-a96e-09847b41df60 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (d242fd8a-2ede-4065-88aa-7f187076d918), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:55.708758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-809561d7-2b67-4811-a96e-09847b41df60 admin admin] Security group rule updated ['c07a431a-5900-49cd-a4fa-00aea90eac14'] Sep 25 00:58:55.960482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-34b7c0b8-7f53-401a-9f52-2e8dd028c389 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:58:55Z,description='Default security group',id=cc225ed5-3fad-4068-9921-b52f2a132527,is_default=True,name='default',project_id='5883265470f0434a87df7adc31ceff1e',revision_number=1,rules=[SecurityGroupRule(2ff97b64-026b-4418-89fe-6f1e0449f9bb),SecurityGroupRule(748d39b6-6ebf-4624-9f0b-dee6dc350088),SecurityGroupRule(927c6ad5-20ef-492b-88ea-b3d6072b80b2),SecurityGroupRule(a2948234-b216-4c71-b1a4-e6d7847729ac)],shared=False,stateful=True,updated_at=2022-09-25T00:58:55Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:55.960871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-34b7c0b8-7f53-401a-9f52-2e8dd028c389 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (cc225ed5-3fad-4068-9921-b52f2a132527), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:55.961527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-34b7c0b8-7f53-401a-9f52-2e8dd028c389 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:55Z,description=,direction='ingress',ethertype='IPv6',id=2ff97b64-026b-4418-89fe-6f1e0449f9bb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5883265470f0434a87df7adc31ceff1e',protocol=,remote_address_group_id=,remote_group_id=cc225ed5-3fad-4068-9921-b52f2a132527,remote_ip_prefix=,revision_number=0,security_group_id=cc225ed5-3fad-4068-9921-b52f2a132527,updated_at=2022-09-25T00:58:55Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:55.961892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-34b7c0b8-7f53-401a-9f52-2e8dd028c389 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (2ff97b64-026b-4418-89fe-6f1e0449f9bb), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:55.962225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-34b7c0b8-7f53-401a-9f52-2e8dd028c389 admin admin] Security group rule updated ['cc225ed5-3fad-4068-9921-b52f2a132527'] Sep 25 00:58:55.962902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-34b7c0b8-7f53-401a-9f52-2e8dd028c389 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:55Z,description=,direction='ingress',ethertype='IPv4',id=748d39b6-6ebf-4624-9f0b-dee6dc350088,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5883265470f0434a87df7adc31ceff1e',protocol=,remote_address_group_id=,remote_group_id=cc225ed5-3fad-4068-9921-b52f2a132527,remote_ip_prefix=,revision_number=0,security_group_id=cc225ed5-3fad-4068-9921-b52f2a132527,updated_at=2022-09-25T00:58:55Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:55.963253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-34b7c0b8-7f53-401a-9f52-2e8dd028c389 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (748d39b6-6ebf-4624-9f0b-dee6dc350088), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:55.963581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-34b7c0b8-7f53-401a-9f52-2e8dd028c389 admin admin] Security group rule updated ['cc225ed5-3fad-4068-9921-b52f2a132527'] Sep 25 00:58:55.964241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-34b7c0b8-7f53-401a-9f52-2e8dd028c389 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:55Z,description=,direction='egress',ethertype='IPv4',id=927c6ad5-20ef-492b-88ea-b3d6072b80b2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5883265470f0434a87df7adc31ceff1e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=cc225ed5-3fad-4068-9921-b52f2a132527,updated_at=2022-09-25T00:58:55Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:55.964593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-34b7c0b8-7f53-401a-9f52-2e8dd028c389 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (927c6ad5-20ef-492b-88ea-b3d6072b80b2), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:55.964918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-34b7c0b8-7f53-401a-9f52-2e8dd028c389 admin admin] Security group rule updated ['cc225ed5-3fad-4068-9921-b52f2a132527'] Sep 25 00:58:55.965610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-34b7c0b8-7f53-401a-9f52-2e8dd028c389 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:55Z,description=,direction='egress',ethertype='IPv6',id=a2948234-b216-4c71-b1a4-e6d7847729ac,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5883265470f0434a87df7adc31ceff1e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=cc225ed5-3fad-4068-9921-b52f2a132527,updated_at=2022-09-25T00:58:55Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:55.965952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-34b7c0b8-7f53-401a-9f52-2e8dd028c389 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (a2948234-b216-4c71-b1a4-e6d7847729ac), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:55.966294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-34b7c0b8-7f53-401a-9f52-2e8dd028c389 admin admin] Security group rule updated ['cc225ed5-3fad-4068-9921-b52f2a132527'] Sep 25 00:58:55.983734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:342 started Sep 25 00:58:55.986346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfa3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=712000000,duration_sec=698,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:55.987189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:58:55.987522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:342 - starting polling. Elapsed:0.004 Sep 25 00:58:55.990845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:55.995742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:342 - port information retrieved. Elapsed:0.012 Sep 25 00:58:55.996173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:342 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 25 00:58:56.099274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-543dcf99-626c-44e7-9293-e287aebfee50 admin admin] Resource SecurityGroup deleted: cc225ed5-3fad-4068-9921-b52f2a132527 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:56.099726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-543dcf99-626c-44e7-9293-e287aebfee50 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (cc225ed5-3fad-4068-9921-b52f2a132527), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:56.100181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-543dcf99-626c-44e7-9293-e287aebfee50 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('cc225ed5-3fad-4068-9921-b52f2a132527',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:58:56.113595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-543dcf99-626c-44e7-9293-e287aebfee50 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('cc225ed5-3fad-4068-9921-b52f2a132527',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:58:56.114203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-543dcf99-626c-44e7-9293-e287aebfee50 admin admin] Resource SecurityGroupRule deleted: 2ff97b64-026b-4418-89fe-6f1e0449f9bb {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:56.114578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-543dcf99-626c-44e7-9293-e287aebfee50 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (2ff97b64-026b-4418-89fe-6f1e0449f9bb), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:56.114919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-543dcf99-626c-44e7-9293-e287aebfee50 admin admin] Security group rule updated ['cc225ed5-3fad-4068-9921-b52f2a132527'] Sep 25 00:58:56.115418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-543dcf99-626c-44e7-9293-e287aebfee50 admin admin] Resource SecurityGroupRule deleted: 748d39b6-6ebf-4624-9f0b-dee6dc350088 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:56.115719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-543dcf99-626c-44e7-9293-e287aebfee50 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (748d39b6-6ebf-4624-9f0b-dee6dc350088), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:56.116258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-543dcf99-626c-44e7-9293-e287aebfee50 admin admin] Security group rule updated ['cc225ed5-3fad-4068-9921-b52f2a132527'] Sep 25 00:58:56.116849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-543dcf99-626c-44e7-9293-e287aebfee50 admin admin] Resource SecurityGroupRule deleted: 927c6ad5-20ef-492b-88ea-b3d6072b80b2 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:56.116978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-543dcf99-626c-44e7-9293-e287aebfee50 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (927c6ad5-20ef-492b-88ea-b3d6072b80b2), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:56.117390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-543dcf99-626c-44e7-9293-e287aebfee50 admin admin] Security group rule updated ['cc225ed5-3fad-4068-9921-b52f2a132527'] Sep 25 00:58:56.117797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-543dcf99-626c-44e7-9293-e287aebfee50 admin admin] Resource SecurityGroupRule deleted: a2948234-b216-4c71-b1a4-e6d7847729ac {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:56.118141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-543dcf99-626c-44e7-9293-e287aebfee50 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (a2948234-b216-4c71-b1a4-e6d7847729ac), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:56.118461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-543dcf99-626c-44e7-9293-e287aebfee50 admin admin] Security group rule updated ['cc225ed5-3fad-4068-9921-b52f2a132527'] Sep 25 00:58:56.426649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 0940e2bc-bbba-4cec-82c5-38b72d995723 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:56.427800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (0940e2bc-bbba-4cec-82c5-38b72d995723), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:56.601164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 96168749-3e0f-462f-9aed-adacd4fb28c0 updated (revision_number 7->8). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'DOWN'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:58:56.601721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (96168749-3e0f-462f-9aed-adacd4fb28c0), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:57.728816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-da3e157b-b27d-426a-8675-f2fa24e4918e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:58:57Z,description='Default security group',id=f9a4ca79-3aee-4a87-8ce4-e3ebc93d49c2,is_default=True,name='default',project_id='47c1ee73157a462fa2f49d2cba00fbb5',revision_number=1,rules=[SecurityGroupRule(6bab1fa4-8910-4bff-9611-b940e4e22651),SecurityGroupRule(966357f5-8736-4441-b0df-d3b9bddaae6c),SecurityGroupRule(c8533eaf-0ce9-484c-9c74-c596a107a718),SecurityGroupRule(f89216b6-f208-47ab-b4e3-90e2764fa225)],shared=False,stateful=True,updated_at=2022-09-25T00:58:57Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:57.729495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-da3e157b-b27d-426a-8675-f2fa24e4918e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (f9a4ca79-3aee-4a87-8ce4-e3ebc93d49c2), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:57.729860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-da3e157b-b27d-426a-8675-f2fa24e4918e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:57Z,description=,direction='ingress',ethertype='IPv6',id=6bab1fa4-8910-4bff-9611-b940e4e22651,normalized_cidr=None,port_range_max=,port_range_min=,project_id='47c1ee73157a462fa2f49d2cba00fbb5',protocol=,remote_address_group_id=,remote_group_id=f9a4ca79-3aee-4a87-8ce4-e3ebc93d49c2,remote_ip_prefix=,revision_number=0,security_group_id=f9a4ca79-3aee-4a87-8ce4-e3ebc93d49c2,updated_at=2022-09-25T00:58:57Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:57.730237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-da3e157b-b27d-426a-8675-f2fa24e4918e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (6bab1fa4-8910-4bff-9611-b940e4e22651), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:57.730579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-da3e157b-b27d-426a-8675-f2fa24e4918e admin admin] Security group rule updated ['f9a4ca79-3aee-4a87-8ce4-e3ebc93d49c2'] Sep 25 00:58:57.731301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-da3e157b-b27d-426a-8675-f2fa24e4918e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:57Z,description=,direction='ingress',ethertype='IPv4',id=966357f5-8736-4441-b0df-d3b9bddaae6c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='47c1ee73157a462fa2f49d2cba00fbb5',protocol=,remote_address_group_id=,remote_group_id=f9a4ca79-3aee-4a87-8ce4-e3ebc93d49c2,remote_ip_prefix=,revision_number=0,security_group_id=f9a4ca79-3aee-4a87-8ce4-e3ebc93d49c2,updated_at=2022-09-25T00:58:57Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:57.731663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-da3e157b-b27d-426a-8675-f2fa24e4918e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (966357f5-8736-4441-b0df-d3b9bddaae6c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:57.731996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-da3e157b-b27d-426a-8675-f2fa24e4918e admin admin] Security group rule updated ['f9a4ca79-3aee-4a87-8ce4-e3ebc93d49c2'] Sep 25 00:58:57.732656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-da3e157b-b27d-426a-8675-f2fa24e4918e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:57Z,description=,direction='egress',ethertype='IPv6',id=c8533eaf-0ce9-484c-9c74-c596a107a718,normalized_cidr=None,port_range_max=,port_range_min=,project_id='47c1ee73157a462fa2f49d2cba00fbb5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f9a4ca79-3aee-4a87-8ce4-e3ebc93d49c2,updated_at=2022-09-25T00:58:57Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:57.733012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-da3e157b-b27d-426a-8675-f2fa24e4918e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (c8533eaf-0ce9-484c-9c74-c596a107a718), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:57.733558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-da3e157b-b27d-426a-8675-f2fa24e4918e admin admin] Security group rule updated ['f9a4ca79-3aee-4a87-8ce4-e3ebc93d49c2'] Sep 25 00:58:57.734500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-da3e157b-b27d-426a-8675-f2fa24e4918e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:58:57Z,description=,direction='egress',ethertype='IPv4',id=f89216b6-f208-47ab-b4e3-90e2764fa225,normalized_cidr=None,port_range_max=,port_range_min=,project_id='47c1ee73157a462fa2f49d2cba00fbb5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f9a4ca79-3aee-4a87-8ce4-e3ebc93d49c2,updated_at=2022-09-25T00:58:57Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:58:57.734718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-da3e157b-b27d-426a-8675-f2fa24e4918e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f89216b6-f208-47ab-b4e3-90e2764fa225), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:57.735905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-da3e157b-b27d-426a-8675-f2fa24e4918e admin admin] Security group rule updated ['f9a4ca79-3aee-4a87-8ce4-e3ebc93d49c2'] Sep 25 00:58:57.874449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d2c2e048-a988-424b-aeca-f4eeb2bef29c admin admin] Resource SecurityGroup deleted: f9a4ca79-3aee-4a87-8ce4-e3ebc93d49c2 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:57.874901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d2c2e048-a988-424b-aeca-f4eeb2bef29c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (f9a4ca79-3aee-4a87-8ce4-e3ebc93d49c2), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:57.875365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2c2e048-a988-424b-aeca-f4eeb2bef29c admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('f9a4ca79-3aee-4a87-8ce4-e3ebc93d49c2',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:58:57.889392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d2c2e048-a988-424b-aeca-f4eeb2bef29c admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('f9a4ca79-3aee-4a87-8ce4-e3ebc93d49c2',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:58:57.889964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d2c2e048-a988-424b-aeca-f4eeb2bef29c admin admin] Resource SecurityGroupRule deleted: 6bab1fa4-8910-4bff-9611-b940e4e22651 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:57.890422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d2c2e048-a988-424b-aeca-f4eeb2bef29c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (6bab1fa4-8910-4bff-9611-b940e4e22651), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:57.890691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d2c2e048-a988-424b-aeca-f4eeb2bef29c admin admin] Security group rule updated ['f9a4ca79-3aee-4a87-8ce4-e3ebc93d49c2'] Sep 25 00:58:57.891056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d2c2e048-a988-424b-aeca-f4eeb2bef29c admin admin] Resource SecurityGroupRule deleted: 966357f5-8736-4441-b0df-d3b9bddaae6c {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:57.891550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d2c2e048-a988-424b-aeca-f4eeb2bef29c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (966357f5-8736-4441-b0df-d3b9bddaae6c), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:57.891905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d2c2e048-a988-424b-aeca-f4eeb2bef29c admin admin] Security group rule updated ['f9a4ca79-3aee-4a87-8ce4-e3ebc93d49c2'] Sep 25 00:58:57.892282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d2c2e048-a988-424b-aeca-f4eeb2bef29c admin admin] Resource SecurityGroupRule deleted: c8533eaf-0ce9-484c-9c74-c596a107a718 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:57.892628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d2c2e048-a988-424b-aeca-f4eeb2bef29c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (c8533eaf-0ce9-484c-9c74-c596a107a718), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:57.892994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d2c2e048-a988-424b-aeca-f4eeb2bef29c admin admin] Security group rule updated ['f9a4ca79-3aee-4a87-8ce4-e3ebc93d49c2'] Sep 25 00:58:57.893401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d2c2e048-a988-424b-aeca-f4eeb2bef29c admin admin] Resource SecurityGroupRule deleted: f89216b6-f208-47ab-b4e3-90e2764fa225 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:58:57.893854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d2c2e048-a988-424b-aeca-f4eeb2bef29c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f89216b6-f208-47ab-b4e3-90e2764fa225), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:57.894061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d2c2e048-a988-424b-aeca-f4eeb2bef29c admin admin] Security group rule updated ['f9a4ca79-3aee-4a87-8ce4-e3ebc93d49c2'] Sep 25 00:58:57.985671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:343 started Sep 25 00:58:57.989731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfa5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=715000000,duration_sec=700,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:57.990318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:58:57.990689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:343 - starting polling. Elapsed:0.006 Sep 25 00:58:57.994920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:58:58.001708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:343 - port information retrieved. Elapsed:0.016 Sep 25 00:58:58.002287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:343 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.018 Sep 25 00:58:59.986381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:344 started Sep 25 00:58:59.989056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfa7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=715000000,duration_sec=702,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:58:59.989855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:58:59.990214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:344 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:59:01.987470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:345 started Sep 25 00:59:01.989975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfa9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=716000000,duration_sec=704,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:59:01.990560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:59:01.990914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:345 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:59:03.988185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:346 started Sep 25 00:59:03.990904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfab,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=716000000,duration_sec=706,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:59:03.991414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:59:03.991770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:346 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:59:05.988956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:347 started Sep 25 00:59:05.991994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfad,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=718000000,duration_sec=708,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:59:05.992614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:59:05.992972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:347 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:59:07.204049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e9330cac-30c5-48b2-b46e-98acbe59ed06 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:59:07Z,description='Default security group',id=13efc87c-179c-4000-a48f-b7e6997e4a89,is_default=True,name='default',project_id='8947f6ece4f4436782be77d7bd8f20dd',revision_number=1,rules=[SecurityGroupRule(248adbc8-96d8-4407-8b6e-c221dbb80de0),SecurityGroupRule(9520b2b7-89bd-49a6-8894-7afcab9f5cf2),SecurityGroupRule(bb8d7445-7596-491c-9ec2-bbdf5f818b22),SecurityGroupRule(fa072f8c-4741-48d2-b89c-746041f0d4e3)],shared=False,stateful=True,updated_at=2022-09-25T00:59:07Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:07.204775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e9330cac-30c5-48b2-b46e-98acbe59ed06 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (13efc87c-179c-4000-a48f-b7e6997e4a89), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:07.205225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e9330cac-30c5-48b2-b46e-98acbe59ed06 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:07Z,description=,direction='egress',ethertype='IPv4',id=248adbc8-96d8-4407-8b6e-c221dbb80de0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8947f6ece4f4436782be77d7bd8f20dd',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=13efc87c-179c-4000-a48f-b7e6997e4a89,updated_at=2022-09-25T00:59:07Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:07.205681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e9330cac-30c5-48b2-b46e-98acbe59ed06 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (248adbc8-96d8-4407-8b6e-c221dbb80de0), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:07.206215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-e9330cac-30c5-48b2-b46e-98acbe59ed06 admin admin] Security group rule updated ['13efc87c-179c-4000-a48f-b7e6997e4a89'] Sep 25 00:59:07.206914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e9330cac-30c5-48b2-b46e-98acbe59ed06 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:07Z,description=,direction='ingress',ethertype='IPv6',id=9520b2b7-89bd-49a6-8894-7afcab9f5cf2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8947f6ece4f4436782be77d7bd8f20dd',protocol=,remote_address_group_id=,remote_group_id=13efc87c-179c-4000-a48f-b7e6997e4a89,remote_ip_prefix=,revision_number=0,security_group_id=13efc87c-179c-4000-a48f-b7e6997e4a89,updated_at=2022-09-25T00:59:07Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:07.207278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e9330cac-30c5-48b2-b46e-98acbe59ed06 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (9520b2b7-89bd-49a6-8894-7afcab9f5cf2), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:07.207614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-e9330cac-30c5-48b2-b46e-98acbe59ed06 admin admin] Security group rule updated ['13efc87c-179c-4000-a48f-b7e6997e4a89'] Sep 25 00:59:07.208276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e9330cac-30c5-48b2-b46e-98acbe59ed06 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:07Z,description=,direction='ingress',ethertype='IPv4',id=bb8d7445-7596-491c-9ec2-bbdf5f818b22,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8947f6ece4f4436782be77d7bd8f20dd',protocol=,remote_address_group_id=,remote_group_id=13efc87c-179c-4000-a48f-b7e6997e4a89,remote_ip_prefix=,revision_number=0,security_group_id=13efc87c-179c-4000-a48f-b7e6997e4a89,updated_at=2022-09-25T00:59:07Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:07.208950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e9330cac-30c5-48b2-b46e-98acbe59ed06 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (bb8d7445-7596-491c-9ec2-bbdf5f818b22), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:07.209483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-e9330cac-30c5-48b2-b46e-98acbe59ed06 admin admin] Security group rule updated ['13efc87c-179c-4000-a48f-b7e6997e4a89'] Sep 25 00:59:07.210150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e9330cac-30c5-48b2-b46e-98acbe59ed06 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:07Z,description=,direction='egress',ethertype='IPv6',id=fa072f8c-4741-48d2-b89c-746041f0d4e3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8947f6ece4f4436782be77d7bd8f20dd',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=13efc87c-179c-4000-a48f-b7e6997e4a89,updated_at=2022-09-25T00:59:07Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:07.210735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e9330cac-30c5-48b2-b46e-98acbe59ed06 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (fa072f8c-4741-48d2-b89c-746041f0d4e3), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:07.211220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-e9330cac-30c5-48b2-b46e-98acbe59ed06 admin admin] Security group rule updated ['13efc87c-179c-4000-a48f-b7e6997e4a89'] Sep 25 00:59:07.601947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ad134818-66b1-4a92-9250-3049594e2d3d admin admin] Resource SecurityGroup deleted: 13efc87c-179c-4000-a48f-b7e6997e4a89 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:07.602306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ad134818-66b1-4a92-9250-3049594e2d3d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (13efc87c-179c-4000-a48f-b7e6997e4a89), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:07.602755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad134818-66b1-4a92-9250-3049594e2d3d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('13efc87c-179c-4000-a48f-b7e6997e4a89',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:59:07.618932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ad134818-66b1-4a92-9250-3049594e2d3d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('13efc87c-179c-4000-a48f-b7e6997e4a89',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:59:07.619662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ad134818-66b1-4a92-9250-3049594e2d3d admin admin] Resource SecurityGroupRule deleted: 248adbc8-96d8-4407-8b6e-c221dbb80de0 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:07.619850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ad134818-66b1-4a92-9250-3049594e2d3d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (248adbc8-96d8-4407-8b6e-c221dbb80de0), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:07.620296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ad134818-66b1-4a92-9250-3049594e2d3d admin admin] Security group rule updated ['13efc87c-179c-4000-a48f-b7e6997e4a89'] Sep 25 00:59:07.620651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ad134818-66b1-4a92-9250-3049594e2d3d admin admin] Resource SecurityGroupRule deleted: 9520b2b7-89bd-49a6-8894-7afcab9f5cf2 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:07.621241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ad134818-66b1-4a92-9250-3049594e2d3d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (9520b2b7-89bd-49a6-8894-7afcab9f5cf2), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:07.621589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ad134818-66b1-4a92-9250-3049594e2d3d admin admin] Security group rule updated ['13efc87c-179c-4000-a48f-b7e6997e4a89'] Sep 25 00:59:07.622115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ad134818-66b1-4a92-9250-3049594e2d3d admin admin] Resource SecurityGroupRule deleted: bb8d7445-7596-491c-9ec2-bbdf5f818b22 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:07.622613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ad134818-66b1-4a92-9250-3049594e2d3d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (bb8d7445-7596-491c-9ec2-bbdf5f818b22), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:07.623114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ad134818-66b1-4a92-9250-3049594e2d3d admin admin] Security group rule updated ['13efc87c-179c-4000-a48f-b7e6997e4a89'] Sep 25 00:59:07.623504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ad134818-66b1-4a92-9250-3049594e2d3d admin admin] Resource SecurityGroupRule deleted: fa072f8c-4741-48d2-b89c-746041f0d4e3 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:07.623837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ad134818-66b1-4a92-9250-3049594e2d3d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (fa072f8c-4741-48d2-b89c-746041f0d4e3), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:07.624160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ad134818-66b1-4a92-9250-3049594e2d3d admin admin] Security group rule updated ['13efc87c-179c-4000-a48f-b7e6997e4a89'] Sep 25 00:59:07.990070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:348 started Sep 25 00:59:07.994141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfaf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=719000000,duration_sec=710,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:59:07.994791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:59:07.995147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:348 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:59:08.185456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3fc6921e-b594-4937-936e-612ddc68699b admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:59:07Z,description='Default security group',id=64128b60-4261-4e75-8f5f-5efc060d12b8,is_default=True,name='default',project_id='8ecf6339cdd841b9baa6a825df16ae79',revision_number=1,rules=[SecurityGroupRule(1a02881a-5dc4-4679-9a93-a0cae382b6df),SecurityGroupRule(b2f8014c-e25b-4850-99c4-b9118a6cbaa1),SecurityGroupRule(be57428b-2bf3-4a35-b581-d0a69ab7a5c9),SecurityGroupRule(e15532f2-af2c-438b-a4c1-dc713ff9b3cd)],shared=False,stateful=True,updated_at=2022-09-25T00:59:08Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:08.185919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3fc6921e-b594-4937-936e-612ddc68699b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (64128b60-4261-4e75-8f5f-5efc060d12b8), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:08.186508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3fc6921e-b594-4937-936e-612ddc68699b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:08Z,description=,direction='ingress',ethertype='IPv4',id=1a02881a-5dc4-4679-9a93-a0cae382b6df,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8ecf6339cdd841b9baa6a825df16ae79',protocol=,remote_address_group_id=,remote_group_id=64128b60-4261-4e75-8f5f-5efc060d12b8,remote_ip_prefix=,revision_number=0,security_group_id=64128b60-4261-4e75-8f5f-5efc060d12b8,updated_at=2022-09-25T00:59:08Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:08.187770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3fc6921e-b594-4937-936e-612ddc68699b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (1a02881a-5dc4-4679-9a93-a0cae382b6df), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:08.188122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-3fc6921e-b594-4937-936e-612ddc68699b admin admin] Security group rule updated ['64128b60-4261-4e75-8f5f-5efc060d12b8'] Sep 25 00:59:08.188820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3fc6921e-b594-4937-936e-612ddc68699b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:08Z,description=,direction='egress',ethertype='IPv4',id=b2f8014c-e25b-4850-99c4-b9118a6cbaa1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8ecf6339cdd841b9baa6a825df16ae79',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=64128b60-4261-4e75-8f5f-5efc060d12b8,updated_at=2022-09-25T00:59:08Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:08.189423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3fc6921e-b594-4937-936e-612ddc68699b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (b2f8014c-e25b-4850-99c4-b9118a6cbaa1), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:08.189763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-3fc6921e-b594-4937-936e-612ddc68699b admin admin] Security group rule updated ['64128b60-4261-4e75-8f5f-5efc060d12b8'] Sep 25 00:59:08.190442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3fc6921e-b594-4937-936e-612ddc68699b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:08Z,description=,direction='ingress',ethertype='IPv6',id=be57428b-2bf3-4a35-b581-d0a69ab7a5c9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8ecf6339cdd841b9baa6a825df16ae79',protocol=,remote_address_group_id=,remote_group_id=64128b60-4261-4e75-8f5f-5efc060d12b8,remote_ip_prefix=,revision_number=0,security_group_id=64128b60-4261-4e75-8f5f-5efc060d12b8,updated_at=2022-09-25T00:59:08Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:08.190804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3fc6921e-b594-4937-936e-612ddc68699b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (be57428b-2bf3-4a35-b581-d0a69ab7a5c9), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:08.191137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-3fc6921e-b594-4937-936e-612ddc68699b admin admin] Security group rule updated ['64128b60-4261-4e75-8f5f-5efc060d12b8'] Sep 25 00:59:08.191798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3fc6921e-b594-4937-936e-612ddc68699b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:08Z,description=,direction='egress',ethertype='IPv6',id=e15532f2-af2c-438b-a4c1-dc713ff9b3cd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8ecf6339cdd841b9baa6a825df16ae79',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=64128b60-4261-4e75-8f5f-5efc060d12b8,updated_at=2022-09-25T00:59:08Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:08.192157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3fc6921e-b594-4937-936e-612ddc68699b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (e15532f2-af2c-438b-a4c1-dc713ff9b3cd), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:08.192487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-3fc6921e-b594-4937-936e-612ddc68699b admin admin] Security group rule updated ['64128b60-4261-4e75-8f5f-5efc060d12b8'] Sep 25 00:59:08.397427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0b99edfa-11c7-4583-b848-4a329b92878d admin admin] Resource SecurityGroup deleted: 64128b60-4261-4e75-8f5f-5efc060d12b8 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:08.399555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0b99edfa-11c7-4583-b848-4a329b92878d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (64128b60-4261-4e75-8f5f-5efc060d12b8), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:08.400279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b99edfa-11c7-4583-b848-4a329b92878d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('64128b60-4261-4e75-8f5f-5efc060d12b8',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:59:08.416956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0b99edfa-11c7-4583-b848-4a329b92878d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('64128b60-4261-4e75-8f5f-5efc060d12b8',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:59:08.417911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0b99edfa-11c7-4583-b848-4a329b92878d admin admin] Resource SecurityGroupRule deleted: 1a02881a-5dc4-4679-9a93-a0cae382b6df {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:08.418515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0b99edfa-11c7-4583-b848-4a329b92878d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (1a02881a-5dc4-4679-9a93-a0cae382b6df), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:08.419100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-0b99edfa-11c7-4583-b848-4a329b92878d admin admin] Security group rule updated ['64128b60-4261-4e75-8f5f-5efc060d12b8'] Sep 25 00:59:08.419677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0b99edfa-11c7-4583-b848-4a329b92878d admin admin] Resource SecurityGroupRule deleted: b2f8014c-e25b-4850-99c4-b9118a6cbaa1 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:08.420247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0b99edfa-11c7-4583-b848-4a329b92878d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (b2f8014c-e25b-4850-99c4-b9118a6cbaa1), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:08.420734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-0b99edfa-11c7-4583-b848-4a329b92878d admin admin] Security group rule updated ['64128b60-4261-4e75-8f5f-5efc060d12b8'] Sep 25 00:59:08.421107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0b99edfa-11c7-4583-b848-4a329b92878d admin admin] Resource SecurityGroupRule deleted: be57428b-2bf3-4a35-b581-d0a69ab7a5c9 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:08.421645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0b99edfa-11c7-4583-b848-4a329b92878d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (be57428b-2bf3-4a35-b581-d0a69ab7a5c9), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:08.422038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-0b99edfa-11c7-4583-b848-4a329b92878d admin admin] Security group rule updated ['64128b60-4261-4e75-8f5f-5efc060d12b8'] Sep 25 00:59:08.422874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0b99edfa-11c7-4583-b848-4a329b92878d admin admin] Resource SecurityGroupRule deleted: e15532f2-af2c-438b-a4c1-dc713ff9b3cd {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:08.423480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0b99edfa-11c7-4583-b848-4a329b92878d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (e15532f2-af2c-438b-a4c1-dc713ff9b3cd), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:08.424442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-0b99edfa-11c7-4583-b848-4a329b92878d admin admin] Security group rule updated ['64128b60-4261-4e75-8f5f-5efc060d12b8'] Sep 25 00:59:08.947895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ba0cb51c-a251-4fdd-a265-e26f13ce1670 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:59:08Z,description='Default security group',id=d4562e4c-020b-496f-a982-f05e30bf983c,is_default=True,name='default',project_id='e66a9f6a493548839c3d2a8c24a597b3',revision_number=1,rules=[SecurityGroupRule(15fb1199-3945-4ac5-83be-cbeba116a831),SecurityGroupRule(f08954da-f106-45a8-b790-276bb9f5793c),SecurityGroupRule(f0bd9c3c-d058-42c0-ab56-dc651f74e72f),SecurityGroupRule(f522b187-85bb-4881-ad78-02eb76d3a3eb)],shared=False,stateful=True,updated_at=2022-09-25T00:59:08Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:08.948369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ba0cb51c-a251-4fdd-a265-e26f13ce1670 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (d4562e4c-020b-496f-a982-f05e30bf983c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:08.949085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ba0cb51c-a251-4fdd-a265-e26f13ce1670 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:08Z,description=,direction='ingress',ethertype='IPv4',id=15fb1199-3945-4ac5-83be-cbeba116a831,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e66a9f6a493548839c3d2a8c24a597b3',protocol=,remote_address_group_id=,remote_group_id=d4562e4c-020b-496f-a982-f05e30bf983c,remote_ip_prefix=,revision_number=0,security_group_id=d4562e4c-020b-496f-a982-f05e30bf983c,updated_at=2022-09-25T00:59:08Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:08.949801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ba0cb51c-a251-4fdd-a265-e26f13ce1670 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (15fb1199-3945-4ac5-83be-cbeba116a831), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:08.950413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ba0cb51c-a251-4fdd-a265-e26f13ce1670 admin admin] Security group rule updated ['d4562e4c-020b-496f-a982-f05e30bf983c'] Sep 25 00:59:08.951398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ba0cb51c-a251-4fdd-a265-e26f13ce1670 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:08Z,description=,direction='ingress',ethertype='IPv6',id=f08954da-f106-45a8-b790-276bb9f5793c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e66a9f6a493548839c3d2a8c24a597b3',protocol=,remote_address_group_id=,remote_group_id=d4562e4c-020b-496f-a982-f05e30bf983c,remote_ip_prefix=,revision_number=0,security_group_id=d4562e4c-020b-496f-a982-f05e30bf983c,updated_at=2022-09-25T00:59:08Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:08.951957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ba0cb51c-a251-4fdd-a265-e26f13ce1670 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f08954da-f106-45a8-b790-276bb9f5793c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:08.952378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ba0cb51c-a251-4fdd-a265-e26f13ce1670 admin admin] Security group rule updated ['d4562e4c-020b-496f-a982-f05e30bf983c'] Sep 25 00:59:08.953121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ba0cb51c-a251-4fdd-a265-e26f13ce1670 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:08Z,description=,direction='egress',ethertype='IPv6',id=f0bd9c3c-d058-42c0-ab56-dc651f74e72f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e66a9f6a493548839c3d2a8c24a597b3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d4562e4c-020b-496f-a982-f05e30bf983c,updated_at=2022-09-25T00:59:08Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:08.954391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ba0cb51c-a251-4fdd-a265-e26f13ce1670 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f0bd9c3c-d058-42c0-ab56-dc651f74e72f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:08.955003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ba0cb51c-a251-4fdd-a265-e26f13ce1670 admin admin] Security group rule updated ['d4562e4c-020b-496f-a982-f05e30bf983c'] Sep 25 00:59:08.956257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ba0cb51c-a251-4fdd-a265-e26f13ce1670 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:08Z,description=,direction='egress',ethertype='IPv4',id=f522b187-85bb-4881-ad78-02eb76d3a3eb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e66a9f6a493548839c3d2a8c24a597b3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d4562e4c-020b-496f-a982-f05e30bf983c,updated_at=2022-09-25T00:59:08Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:08.956958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ba0cb51c-a251-4fdd-a265-e26f13ce1670 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f522b187-85bb-4881-ad78-02eb76d3a3eb), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:08.957652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ba0cb51c-a251-4fdd-a265-e26f13ce1670 admin admin] Security group rule updated ['d4562e4c-020b-496f-a982-f05e30bf983c'] Sep 25 00:59:09.125110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2c75c19e-4814-493e-a602-2e59c25d655b admin admin] Resource SecurityGroup deleted: d4562e4c-020b-496f-a982-f05e30bf983c {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:09.125758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2c75c19e-4814-493e-a602-2e59c25d655b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (d4562e4c-020b-496f-a982-f05e30bf983c), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:09.126630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c75c19e-4814-493e-a602-2e59c25d655b admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('d4562e4c-020b-496f-a982-f05e30bf983c',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:59:09.141760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2c75c19e-4814-493e-a602-2e59c25d655b admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('d4562e4c-020b-496f-a982-f05e30bf983c',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:59:09.142469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2c75c19e-4814-493e-a602-2e59c25d655b admin admin] Resource SecurityGroupRule deleted: 15fb1199-3945-4ac5-83be-cbeba116a831 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:09.142858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2c75c19e-4814-493e-a602-2e59c25d655b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (15fb1199-3945-4ac5-83be-cbeba116a831), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:09.143203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2c75c19e-4814-493e-a602-2e59c25d655b admin admin] Security group rule updated ['d4562e4c-020b-496f-a982-f05e30bf983c'] Sep 25 00:59:09.143631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2c75c19e-4814-493e-a602-2e59c25d655b admin admin] Resource SecurityGroupRule deleted: f08954da-f106-45a8-b790-276bb9f5793c {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:09.143993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2c75c19e-4814-493e-a602-2e59c25d655b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f08954da-f106-45a8-b790-276bb9f5793c), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:09.144326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2c75c19e-4814-493e-a602-2e59c25d655b admin admin] Security group rule updated ['d4562e4c-020b-496f-a982-f05e30bf983c'] Sep 25 00:59:09.144700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2c75c19e-4814-493e-a602-2e59c25d655b admin admin] Resource SecurityGroupRule deleted: f0bd9c3c-d058-42c0-ab56-dc651f74e72f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:09.145405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2c75c19e-4814-493e-a602-2e59c25d655b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f0bd9c3c-d058-42c0-ab56-dc651f74e72f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:09.145924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2c75c19e-4814-493e-a602-2e59c25d655b admin admin] Security group rule updated ['d4562e4c-020b-496f-a982-f05e30bf983c'] Sep 25 00:59:09.146604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2c75c19e-4814-493e-a602-2e59c25d655b admin admin] Resource SecurityGroupRule deleted: f522b187-85bb-4881-ad78-02eb76d3a3eb {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:09.147108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2c75c19e-4814-493e-a602-2e59c25d655b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f522b187-85bb-4881-ad78-02eb76d3a3eb), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:09.147643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2c75c19e-4814-493e-a602-2e59c25d655b admin admin] Security group rule updated ['d4562e4c-020b-496f-a982-f05e30bf983c'] Sep 25 00:59:09.991762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:349 started Sep 25 00:59:09.995217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfb1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=720000000,duration_sec=712,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:59:09.996135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:59:09.996259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:349 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:59:11.992743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:350 started Sep 25 00:59:11.996490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfb3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=722000000,duration_sec=714,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:59:11.997209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:59:11.997782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:350 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 00:59:13.459977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-29e369f7-6c35-4fa6-a8bd-8bf5c6f77e2c admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:59:13Z,description='Default security group',id=873e5625-3408-481c-b0c5-8f4fc9c96577,is_default=True,name='default',project_id='9c8f88cd571d4d64a04c4ba80c5f3530',revision_number=1,rules=[SecurityGroupRule(42e96c19-9afd-4150-9d3d-4f265e45c95b),SecurityGroupRule(48eb5af9-a30e-4227-9d11-74daeace675d),SecurityGroupRule(f96863da-b24e-4619-9bb5-521cf274533c),SecurityGroupRule(fe47d5ee-ba44-472a-b630-b20967e247aa)],shared=False,stateful=True,updated_at=2022-09-25T00:59:13Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:13.461146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-29e369f7-6c35-4fa6-a8bd-8bf5c6f77e2c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (873e5625-3408-481c-b0c5-8f4fc9c96577), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:13.461146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-29e369f7-6c35-4fa6-a8bd-8bf5c6f77e2c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:13Z,description=,direction='ingress',ethertype='IPv6',id=42e96c19-9afd-4150-9d3d-4f265e45c95b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9c8f88cd571d4d64a04c4ba80c5f3530',protocol=,remote_address_group_id=,remote_group_id=873e5625-3408-481c-b0c5-8f4fc9c96577,remote_ip_prefix=,revision_number=0,security_group_id=873e5625-3408-481c-b0c5-8f4fc9c96577,updated_at=2022-09-25T00:59:13Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:13.461565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-29e369f7-6c35-4fa6-a8bd-8bf5c6f77e2c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (42e96c19-9afd-4150-9d3d-4f265e45c95b), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:13.461682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-29e369f7-6c35-4fa6-a8bd-8bf5c6f77e2c admin admin] Security group rule updated ['873e5625-3408-481c-b0c5-8f4fc9c96577'] Sep 25 00:59:13.462349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-29e369f7-6c35-4fa6-a8bd-8bf5c6f77e2c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:13Z,description=,direction='egress',ethertype='IPv4',id=48eb5af9-a30e-4227-9d11-74daeace675d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9c8f88cd571d4d64a04c4ba80c5f3530',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=873e5625-3408-481c-b0c5-8f4fc9c96577,updated_at=2022-09-25T00:59:13Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:13.463010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-29e369f7-6c35-4fa6-a8bd-8bf5c6f77e2c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (48eb5af9-a30e-4227-9d11-74daeace675d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:13.463398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-29e369f7-6c35-4fa6-a8bd-8bf5c6f77e2c admin admin] Security group rule updated ['873e5625-3408-481c-b0c5-8f4fc9c96577'] Sep 25 00:59:13.464144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-29e369f7-6c35-4fa6-a8bd-8bf5c6f77e2c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:13Z,description=,direction='ingress',ethertype='IPv4',id=f96863da-b24e-4619-9bb5-521cf274533c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9c8f88cd571d4d64a04c4ba80c5f3530',protocol=,remote_address_group_id=,remote_group_id=873e5625-3408-481c-b0c5-8f4fc9c96577,remote_ip_prefix=,revision_number=0,security_group_id=873e5625-3408-481c-b0c5-8f4fc9c96577,updated_at=2022-09-25T00:59:13Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:13.464507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-29e369f7-6c35-4fa6-a8bd-8bf5c6f77e2c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f96863da-b24e-4619-9bb5-521cf274533c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:13.464839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-29e369f7-6c35-4fa6-a8bd-8bf5c6f77e2c admin admin] Security group rule updated ['873e5625-3408-481c-b0c5-8f4fc9c96577'] Sep 25 00:59:13.465534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-29e369f7-6c35-4fa6-a8bd-8bf5c6f77e2c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:13Z,description=,direction='egress',ethertype='IPv6',id=fe47d5ee-ba44-472a-b630-b20967e247aa,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9c8f88cd571d4d64a04c4ba80c5f3530',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=873e5625-3408-481c-b0c5-8f4fc9c96577,updated_at=2022-09-25T00:59:13Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:13.465891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-29e369f7-6c35-4fa6-a8bd-8bf5c6f77e2c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (fe47d5ee-ba44-472a-b630-b20967e247aa), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:13.466218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-29e369f7-6c35-4fa6-a8bd-8bf5c6f77e2c admin admin] Security group rule updated ['873e5625-3408-481c-b0c5-8f4fc9c96577'] Sep 25 00:59:13.600575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-82ade380-54cc-4ba6-9d34-c1af891f33f3 admin admin] Resource SecurityGroup deleted: 873e5625-3408-481c-b0c5-8f4fc9c96577 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:13.601048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-82ade380-54cc-4ba6-9d34-c1af891f33f3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (873e5625-3408-481c-b0c5-8f4fc9c96577), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:13.601772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82ade380-54cc-4ba6-9d34-c1af891f33f3 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('873e5625-3408-481c-b0c5-8f4fc9c96577',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:59:13.615144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-82ade380-54cc-4ba6-9d34-c1af891f33f3 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('873e5625-3408-481c-b0c5-8f4fc9c96577',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:59:13.615860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-82ade380-54cc-4ba6-9d34-c1af891f33f3 admin admin] Resource SecurityGroupRule deleted: 42e96c19-9afd-4150-9d3d-4f265e45c95b {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:13.616240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-82ade380-54cc-4ba6-9d34-c1af891f33f3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (42e96c19-9afd-4150-9d3d-4f265e45c95b), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:13.616577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-82ade380-54cc-4ba6-9d34-c1af891f33f3 admin admin] Security group rule updated ['873e5625-3408-481c-b0c5-8f4fc9c96577'] Sep 25 00:59:13.616971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-82ade380-54cc-4ba6-9d34-c1af891f33f3 admin admin] Resource SecurityGroupRule deleted: 48eb5af9-a30e-4227-9d11-74daeace675d {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:13.617442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-82ade380-54cc-4ba6-9d34-c1af891f33f3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (48eb5af9-a30e-4227-9d11-74daeace675d), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:13.617814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-82ade380-54cc-4ba6-9d34-c1af891f33f3 admin admin] Security group rule updated ['873e5625-3408-481c-b0c5-8f4fc9c96577'] Sep 25 00:59:13.618172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-82ade380-54cc-4ba6-9d34-c1af891f33f3 admin admin] Resource SecurityGroupRule deleted: f96863da-b24e-4619-9bb5-521cf274533c {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:13.618519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-82ade380-54cc-4ba6-9d34-c1af891f33f3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f96863da-b24e-4619-9bb5-521cf274533c), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:13.618831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-82ade380-54cc-4ba6-9d34-c1af891f33f3 admin admin] Security group rule updated ['873e5625-3408-481c-b0c5-8f4fc9c96577'] Sep 25 00:59:13.619471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-82ade380-54cc-4ba6-9d34-c1af891f33f3 admin admin] Resource SecurityGroupRule deleted: fe47d5ee-ba44-472a-b630-b20967e247aa {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:13.620277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-82ade380-54cc-4ba6-9d34-c1af891f33f3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (fe47d5ee-ba44-472a-b630-b20967e247aa), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:13.620784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-82ade380-54cc-4ba6-9d34-c1af891f33f3 admin admin] Security group rule updated ['873e5625-3408-481c-b0c5-8f4fc9c96577'] Sep 25 00:59:13.994390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:351 started Sep 25 00:59:13.996837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfb5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=723000000,duration_sec=716,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:59:13.997508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:59:13.998492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:351 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:59:15.995919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:352 started Sep 25 00:59:15.998765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfb7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=724000000,duration_sec=718,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:59:15.999430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:59:15.999900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:352 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:59:17.994116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-cd4fe71c-5412-453d-86ac-88e1c4139f95 tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:59:17Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=fcf9514b-30ed-4617-ba23-6d05a475dfb7,mac_address=fa:16:3e:e2:47:13,name='',network_id=62195cd6-54fa-4e24-9d47-ae0de6356ac2,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(fcf9514b-30ed-4617-ba23-6d05a475dfb7),security_group_ids=set([]),status='N/A',updated_at=2022-09-25T00:59:17Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:17.994746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-cd4fe71c-5412-453d-86ac-88e1c4139f95 tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (fcf9514b-30ed-4617-ba23-6d05a475dfb7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:17.996556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:353 started Sep 25 00:59:17.999391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfb9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=725000000,duration_sec=720,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:59:18.000666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:59:18.001165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:353 - starting polling. Elapsed:0.004 Sep 25 00:59:18.004500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:18.009818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:353 - port information retrieved. Elapsed:0.013 Sep 25 00:59:18.010244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:353 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 25 00:59:18.707335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-cd4fe71c-5412-453d-86ac-88e1c4139f95 tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Resource Port fcf9514b-30ed-4617-ba23-6d05a475dfb7 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '1d603368-223d-4db7-bf9d-0dd44b55ec88'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:59:18.707911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-cd4fe71c-5412-453d-86ac-88e1c4139f95 tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (fcf9514b-30ed-4617-ba23-6d05a475dfb7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:19.592693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d1accdd4-8bbf-4268-a773-1325f0ddbe7f tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:59:19Z,description='tempest-secgroup-smoke-211599788 description',id=42581346-2174-404e-9723-a7e42899addf,is_default=False,name='tempest-secgroup-smoke-211599788',project_id='b161c2e2dd1f42159dc0d71e8216516c',revision_number=1,rules=[SecurityGroupRule(0618770f-c33d-46a3-80cc-a268b293a7ff),SecurityGroupRule(4f035256-e6fb-4f3a-8fb8-1b73fe110b2c)],shared=False,stateful=True,updated_at=2022-09-25T00:59:19Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:19.593817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d1accdd4-8bbf-4268-a773-1325f0ddbe7f tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (42581346-2174-404e-9723-a7e42899addf), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:19.594374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d1accdd4-8bbf-4268-a773-1325f0ddbe7f tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:19Z,description=,direction='egress',ethertype='IPv4',id=0618770f-c33d-46a3-80cc-a268b293a7ff,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b161c2e2dd1f42159dc0d71e8216516c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=42581346-2174-404e-9723-a7e42899addf,updated_at=2022-09-25T00:59:19Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:19.594989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d1accdd4-8bbf-4268-a773-1325f0ddbe7f tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (0618770f-c33d-46a3-80cc-a268b293a7ff), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:19.595330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d1accdd4-8bbf-4268-a773-1325f0ddbe7f tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Security group rule updated ['42581346-2174-404e-9723-a7e42899addf'] Sep 25 00:59:19.596017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d1accdd4-8bbf-4268-a773-1325f0ddbe7f tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:19Z,description=,direction='egress',ethertype='IPv6',id=4f035256-e6fb-4f3a-8fb8-1b73fe110b2c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b161c2e2dd1f42159dc0d71e8216516c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=42581346-2174-404e-9723-a7e42899addf,updated_at=2022-09-25T00:59:19Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:19.596377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d1accdd4-8bbf-4268-a773-1325f0ddbe7f tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (4f035256-e6fb-4f3a-8fb8-1b73fe110b2c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:19.596902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d1accdd4-8bbf-4268-a773-1325f0ddbe7f tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Security group rule updated ['42581346-2174-404e-9723-a7e42899addf'] Sep 25 00:59:19.746197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0893b1c0-8572-41fb-a959-b9dbdf5cd0ed tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:19Z,description='',direction='ingress',ethertype='IPv4',id=f150cc34-473b-40cc-8bb0-c0dbc4779baf,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='b161c2e2dd1f42159dc0d71e8216516c',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=42581346-2174-404e-9723-a7e42899addf,updated_at=2022-09-25T00:59:19Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:19.746585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0893b1c0-8572-41fb-a959-b9dbdf5cd0ed tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f150cc34-473b-40cc-8bb0-c0dbc4779baf), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:19.746930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-0893b1c0-8572-41fb-a959-b9dbdf5cd0ed tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Security group rule updated ['42581346-2174-404e-9723-a7e42899addf'] Sep 25 00:59:19.913550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1cbd0d8c-ad16-4f0a-b709-54c12c87ba44 tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:19Z,description='',direction='egress',ethertype='IPv4',id=142c49b6-4fd3-4318-9135-08fabbd60f4e,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='b161c2e2dd1f42159dc0d71e8216516c',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=42581346-2174-404e-9723-a7e42899addf,updated_at=2022-09-25T00:59:19Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:19.913787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1cbd0d8c-ad16-4f0a-b709-54c12c87ba44 tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (142c49b6-4fd3-4318-9135-08fabbd60f4e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:19.914348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1cbd0d8c-ad16-4f0a-b709-54c12c87ba44 tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Security group rule updated ['42581346-2174-404e-9723-a7e42899addf'] Sep 25 00:59:19.997386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:354 started Sep 25 00:59:20.000563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfbb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=726000000,duration_sec=722,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:59:20.001690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:59:20.002319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:354 - starting polling. Elapsed:0.005 Sep 25 00:59:20.005847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:20.011262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:354 - port information retrieved. Elapsed:0.014 Sep 25 00:59:20.011856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:354 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Sep 25 00:59:20.156627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-04f1ded7-cacf-4982-8b0e-aa50d1d37fa7 tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:20Z,description='',direction='ingress',ethertype='IPv4',id=a8823e8f-f721-42f1-83a2-ff21e8a05ad4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b161c2e2dd1f42159dc0d71e8216516c',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=42581346-2174-404e-9723-a7e42899addf,updated_at=2022-09-25T00:59:20Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:20.157073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-04f1ded7-cacf-4982-8b0e-aa50d1d37fa7 tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (a8823e8f-f721-42f1-83a2-ff21e8a05ad4), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:20.157599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-04f1ded7-cacf-4982-8b0e-aa50d1d37fa7 tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Security group rule updated ['42581346-2174-404e-9723-a7e42899addf'] Sep 25 00:59:20.335421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b747ad7f-197c-48e3-911e-2ee553652ed9 tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:20Z,description='',direction='egress',ethertype='IPv4',id=f9730db3-f249-4de5-b45f-0afa428b03dd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b161c2e2dd1f42159dc0d71e8216516c',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=42581346-2174-404e-9723-a7e42899addf,updated_at=2022-09-25T00:59:20Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:20.336396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b747ad7f-197c-48e3-911e-2ee553652ed9 tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f9730db3-f249-4de5-b45f-0afa428b03dd), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:20.336936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b747ad7f-197c-48e3-911e-2ee553652ed9 tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Security group rule updated ['42581346-2174-404e-9723-a7e42899addf'] Sep 25 00:59:20.521633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ea4dc24b-9ce0-4bfb-9ceb-7c63f984f6b5 tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:20Z,description='',direction='ingress',ethertype='IPv6',id=4ec650d0-9e1c-41f7-9f70-9494e09c94d7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b161c2e2dd1f42159dc0d71e8216516c',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=42581346-2174-404e-9723-a7e42899addf,updated_at=2022-09-25T00:59:20Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:20.521633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ea4dc24b-9ce0-4bfb-9ceb-7c63f984f6b5 tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (4ec650d0-9e1c-41f7-9f70-9494e09c94d7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:20.521633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ea4dc24b-9ce0-4bfb-9ceb-7c63f984f6b5 tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Security group rule updated ['42581346-2174-404e-9723-a7e42899addf'] Sep 25 00:59:20.721512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b9671c38-e6a4-489a-bfe1-3a61a97daaa2 tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:20Z,description='',direction='egress',ethertype='IPv6',id=043a5495-adb6-4b83-8724-e65c69edb600,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b161c2e2dd1f42159dc0d71e8216516c',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=42581346-2174-404e-9723-a7e42899addf,updated_at=2022-09-25T00:59:20Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:20.722813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b9671c38-e6a4-489a-bfe1-3a61a97daaa2 tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (043a5495-adb6-4b83-8724-e65c69edb600), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:20.723153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b9671c38-e6a4-489a-bfe1-3a61a97daaa2 tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Security group rule updated ['42581346-2174-404e-9723-a7e42899addf'] Sep 25 00:59:21.332591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1106daca-64ae-4ada-9e49-563090d8f6a5 tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Resource Port 0940e2bc-bbba-4cec-82c5-38b72d995723 updated (revision_number 5->6). Old fields: {'security_group_ids': CoercedSet({'5820ec3a-8d2a-47c6-8b82-59a1dad211f3'})} New fields: {'security_group_ids': CoercedSet({'5820ec3a-8d2a-47c6-8b82-59a1dad211f3', '42581346-2174-404e-9723-a7e42899addf'})} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:59:21.332980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1106daca-64ae-4ada-9e49-563090d8f6a5 tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (0940e2bc-bbba-4cec-82c5-38b72d995723), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:21.333463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1106daca-64ae-4ada-9e49-563090d8f6a5 tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Security group member updated {'5820ec3a-8d2a-47c6-8b82-59a1dad211f3', '42581346-2174-404e-9723-a7e42899addf'} Sep 25 00:59:21.999126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:355 started Sep 25 00:59:22.001767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfbd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=728000000,duration_sec=724,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:59:22.002348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:59:22.002688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:355 - starting polling. Elapsed:0.004 Sep 25 00:59:22.006138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:22.010637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:355 - port information retrieved. Elapsed:0.012 Sep 25 00:59:22.010988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:355 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 25 00:59:24.000594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:356 started Sep 25 00:59:24.003819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfbf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=730000000,duration_sec=726,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:59:24.004411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:59:24.004764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:356 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:59:24.541668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 96168749-3e0f-462f-9aed-adacd4fb28c0 updated (revision_number 8->9). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:59:24.542053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (96168749-3e0f-462f-9aed-adacd4fb28c0), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:25.510979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f90815b0-4d3c-43a4-bff3-bea363801264 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:59:25Z,description='Default security group',id=c3c89207-03b8-4e16-ac46-df1c1c66a81d,is_default=True,name='default',project_id='dc7b27c40a734bbcb44abaa5590f0df8',revision_number=1,rules=[SecurityGroupRule(0737c980-b0c7-4946-856c-7a4eae6d33ca),SecurityGroupRule(4d9fc873-d78e-429e-acfc-baa07a80d96e),SecurityGroupRule(be42aebf-6513-484b-97a6-a8c6348bbca8),SecurityGroupRule(e7aec53f-3e10-490a-b4b2-a3ea2eb90cd4)],shared=False,stateful=True,updated_at=2022-09-25T00:59:25Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:25.511600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f90815b0-4d3c-43a4-bff3-bea363801264 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (c3c89207-03b8-4e16-ac46-df1c1c66a81d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:25.512111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f90815b0-4d3c-43a4-bff3-bea363801264 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:25Z,description=,direction='egress',ethertype='IPv4',id=0737c980-b0c7-4946-856c-7a4eae6d33ca,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dc7b27c40a734bbcb44abaa5590f0df8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c3c89207-03b8-4e16-ac46-df1c1c66a81d,updated_at=2022-09-25T00:59:25Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:25.512481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f90815b0-4d3c-43a4-bff3-bea363801264 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (0737c980-b0c7-4946-856c-7a4eae6d33ca), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:25.512819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f90815b0-4d3c-43a4-bff3-bea363801264 admin admin] Security group rule updated ['c3c89207-03b8-4e16-ac46-df1c1c66a81d'] Sep 25 00:59:25.513529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f90815b0-4d3c-43a4-bff3-bea363801264 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:25Z,description=,direction='ingress',ethertype='IPv6',id=4d9fc873-d78e-429e-acfc-baa07a80d96e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dc7b27c40a734bbcb44abaa5590f0df8',protocol=,remote_address_group_id=,remote_group_id=c3c89207-03b8-4e16-ac46-df1c1c66a81d,remote_ip_prefix=,revision_number=0,security_group_id=c3c89207-03b8-4e16-ac46-df1c1c66a81d,updated_at=2022-09-25T00:59:25Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:25.513893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f90815b0-4d3c-43a4-bff3-bea363801264 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (4d9fc873-d78e-429e-acfc-baa07a80d96e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:25.514224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f90815b0-4d3c-43a4-bff3-bea363801264 admin admin] Security group rule updated ['c3c89207-03b8-4e16-ac46-df1c1c66a81d'] Sep 25 00:59:25.514886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f90815b0-4d3c-43a4-bff3-bea363801264 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:25Z,description=,direction='ingress',ethertype='IPv4',id=be42aebf-6513-484b-97a6-a8c6348bbca8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dc7b27c40a734bbcb44abaa5590f0df8',protocol=,remote_address_group_id=,remote_group_id=c3c89207-03b8-4e16-ac46-df1c1c66a81d,remote_ip_prefix=,revision_number=0,security_group_id=c3c89207-03b8-4e16-ac46-df1c1c66a81d,updated_at=2022-09-25T00:59:25Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:25.515799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f90815b0-4d3c-43a4-bff3-bea363801264 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (be42aebf-6513-484b-97a6-a8c6348bbca8), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:25.516130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f90815b0-4d3c-43a4-bff3-bea363801264 admin admin] Security group rule updated ['c3c89207-03b8-4e16-ac46-df1c1c66a81d'] Sep 25 00:59:25.516788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f90815b0-4d3c-43a4-bff3-bea363801264 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:25Z,description=,direction='egress',ethertype='IPv6',id=e7aec53f-3e10-490a-b4b2-a3ea2eb90cd4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dc7b27c40a734bbcb44abaa5590f0df8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c3c89207-03b8-4e16-ac46-df1c1c66a81d,updated_at=2022-09-25T00:59:25Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:25.517139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f90815b0-4d3c-43a4-bff3-bea363801264 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (e7aec53f-3e10-490a-b4b2-a3ea2eb90cd4), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:25.517500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f90815b0-4d3c-43a4-bff3-bea363801264 admin admin] Security group rule updated ['c3c89207-03b8-4e16-ac46-df1c1c66a81d'] Sep 25 00:59:25.644639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-34be2554-1adc-4fe6-968c-ab0268a9f21b admin admin] Resource SecurityGroup deleted: c3c89207-03b8-4e16-ac46-df1c1c66a81d {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:25.644992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-34be2554-1adc-4fe6-968c-ab0268a9f21b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (c3c89207-03b8-4e16-ac46-df1c1c66a81d), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:25.645541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34be2554-1adc-4fe6-968c-ab0268a9f21b admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c3c89207-03b8-4e16-ac46-df1c1c66a81d',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:59:25.660982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-34be2554-1adc-4fe6-968c-ab0268a9f21b admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c3c89207-03b8-4e16-ac46-df1c1c66a81d',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:59:25.661977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-34be2554-1adc-4fe6-968c-ab0268a9f21b admin admin] Resource SecurityGroupRule deleted: 0737c980-b0c7-4946-856c-7a4eae6d33ca {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:25.661977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-34be2554-1adc-4fe6-968c-ab0268a9f21b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (0737c980-b0c7-4946-856c-7a4eae6d33ca), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:25.662493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-34be2554-1adc-4fe6-968c-ab0268a9f21b admin admin] Security group rule updated ['c3c89207-03b8-4e16-ac46-df1c1c66a81d'] Sep 25 00:59:25.662973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-34be2554-1adc-4fe6-968c-ab0268a9f21b admin admin] Resource SecurityGroupRule deleted: 4d9fc873-d78e-429e-acfc-baa07a80d96e {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:25.663377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-34be2554-1adc-4fe6-968c-ab0268a9f21b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (4d9fc873-d78e-429e-acfc-baa07a80d96e), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:25.663775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-34be2554-1adc-4fe6-968c-ab0268a9f21b admin admin] Security group rule updated ['c3c89207-03b8-4e16-ac46-df1c1c66a81d'] Sep 25 00:59:25.664223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-34be2554-1adc-4fe6-968c-ab0268a9f21b admin admin] Resource SecurityGroupRule deleted: be42aebf-6513-484b-97a6-a8c6348bbca8 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:25.664651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-34be2554-1adc-4fe6-968c-ab0268a9f21b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (be42aebf-6513-484b-97a6-a8c6348bbca8), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:25.665031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-34be2554-1adc-4fe6-968c-ab0268a9f21b admin admin] Security group rule updated ['c3c89207-03b8-4e16-ac46-df1c1c66a81d'] Sep 25 00:59:25.665504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-34be2554-1adc-4fe6-968c-ab0268a9f21b admin admin] Resource SecurityGroupRule deleted: e7aec53f-3e10-490a-b4b2-a3ea2eb90cd4 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:25.665910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-34be2554-1adc-4fe6-968c-ab0268a9f21b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (e7aec53f-3e10-490a-b4b2-a3ea2eb90cd4), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:25.666251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-34be2554-1adc-4fe6-968c-ab0268a9f21b admin admin] Security group rule updated ['c3c89207-03b8-4e16-ac46-df1c1c66a81d'] Sep 25 00:59:26.001133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:357 started Sep 25 00:59:26.003873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfc1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=730000000,duration_sec=728,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:59:26.004528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:59:26.004955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:357 - starting polling. Elapsed:0.004 Sep 25 00:59:26.008082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:26.012479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:357 - port information retrieved. Elapsed:0.012 Sep 25 00:59:26.012808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:357 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 25 00:59:26.549479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 96168749-3e0f-462f-9aed-adacd4fb28c0 updated (revision_number 9->10). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:59:26.550238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (96168749-3e0f-462f-9aed-adacd4fb28c0), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:28.002073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:358 started Sep 25 00:59:28.004607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfc3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=730000000,duration_sec=730,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:59:28.005102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:59:28.005469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:358 - starting polling. Elapsed:0.004 Sep 25 00:59:28.008646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:28.013181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:358 - port information retrieved. Elapsed:0.011 Sep 25 00:59:28.013552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:358 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 25 00:59:30.003132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:359 started Sep 25 00:59:30.005611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfc5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=731000000,duration_sec=732,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:59:30.006182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:59:30.006536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:359 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:59:32.003824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:360 started Sep 25 00:59:32.006499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfc7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=732000000,duration_sec=734,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:59:32.007066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:59:32.007423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:360 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:59:34.005200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:361 started Sep 25 00:59:34.008822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfc9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=734000000,duration_sec=736,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:59:34.010333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:59:34.010754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:361 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 00:59:36.006438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:362 started Sep 25 00:59:36.009197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfcb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=735000000,duration_sec=738,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:59:36.009866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:59:36.010248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:362 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:59:37.268934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8d04b4f0-5337-4fdd-941d-7dd211d4d49b tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource Port deleted: 36da5046-389c-4afa-9d14-41833f5b0db3 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:37.269652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8d04b4f0-5337-4fdd-941d-7dd211d4d49b tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (36da5046-389c-4afa-9d14-41833f5b0db3), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:37.269800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8d04b4f0-5337-4fdd-941d-7dd211d4d49b tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group member updated {'f0d3b914-378e-40fe-b150-c8676dc91021'} Sep 25 00:59:38.007484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:363 started Sep 25 00:59:38.010064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfcd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=736000000,duration_sec=740,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:59:38.010805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:59:38.011152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:363 - starting polling. Elapsed:0.004 Sep 25 00:59:38.014513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:38.016805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 36da5046-389c-4afa-9d14-41833f5b0db3 not present in bridge br-int Sep 25 00:59:38.017147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 00:59:38.017475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['36da5046-389c-4afa-9d14-41833f5b0db3'] Sep 25 00:59:38.017807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 36da5046-389c-4afa-9d14-41833f5b0db3 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 00:59:38.022303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:363 - port information retrieved. Elapsed:0.015 Sep 25 00:59:38.022646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:363 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Sep 25 00:59:40.008776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:364 started Sep 25 00:59:40.011319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfcf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=737000000,duration_sec=742,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:59:40.011926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:59:40.012279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:364 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:59:40.775591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1036637d-7d10-4580-836b-46e208f753fb tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource SecurityGroup deleted: f0d3b914-378e-40fe-b150-c8676dc91021 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:40.775973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1036637d-7d10-4580-836b-46e208f753fb tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (f0d3b914-378e-40fe-b150-c8676dc91021), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:40.776483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1036637d-7d10-4580-836b-46e208f753fb tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('f0d3b914-378e-40fe-b150-c8676dc91021',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:59:40.796076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1036637d-7d10-4580-836b-46e208f753fb tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('f0d3b914-378e-40fe-b150-c8676dc91021',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:59:40.796649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1036637d-7d10-4580-836b-46e208f753fb tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource SecurityGroupRule deleted: 0b5e71d7-8c6d-471a-9d67-d729ebe64ff6 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:40.797040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1036637d-7d10-4580-836b-46e208f753fb tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (0b5e71d7-8c6d-471a-9d67-d729ebe64ff6), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:40.797415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1036637d-7d10-4580-836b-46e208f753fb tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['f0d3b914-378e-40fe-b150-c8676dc91021'] Sep 25 00:59:40.797863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1036637d-7d10-4580-836b-46e208f753fb tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource SecurityGroupRule deleted: c027b006-f9d5-465c-9199-eef4b69be0e3 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:40.798217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1036637d-7d10-4580-836b-46e208f753fb tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (c027b006-f9d5-465c-9199-eef4b69be0e3), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:40.798884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1036637d-7d10-4580-836b-46e208f753fb tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['f0d3b914-378e-40fe-b150-c8676dc91021'] Sep 25 00:59:40.799176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1036637d-7d10-4580-836b-46e208f753fb tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource SecurityGroupRule deleted: 337da1e7-c10b-4602-b14e-978e665de34a {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:40.799563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1036637d-7d10-4580-836b-46e208f753fb tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (337da1e7-c10b-4602-b14e-978e665de34a), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:40.799941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1036637d-7d10-4580-836b-46e208f753fb tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['f0d3b914-378e-40fe-b150-c8676dc91021'] Sep 25 00:59:40.800324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1036637d-7d10-4580-836b-46e208f753fb tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource SecurityGroupRule deleted: 74192d7c-d8ce-43e6-aa07-67e6e7a4940a {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:40.800696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1036637d-7d10-4580-836b-46e208f753fb tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (74192d7c-d8ce-43e6-aa07-67e6e7a4940a), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:40.801131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1036637d-7d10-4580-836b-46e208f753fb tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['f0d3b914-378e-40fe-b150-c8676dc91021'] Sep 25 00:59:41.187857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-946b58ba-dfc6-4048-9efd-53dd8ed7bb35 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource Port deleted: 5782af87-0b4f-4824-aed9-541addf429b2 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:41.188715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-946b58ba-dfc6-4048-9efd-53dd8ed7bb35 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (5782af87-0b4f-4824-aed9-541addf429b2), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:42.009656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:365 started Sep 25 00:59:42.012190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfd1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=738000000,duration_sec=744,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:59:42.012769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:59:42.013102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:365 - starting polling. Elapsed:0.004 Sep 25 00:59:42.016596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:42.018815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 5782af87-0b4f-4824-aed9-541addf429b2 not present in bridge br-int Sep 25 00:59:42.019148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 00:59:42.019429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['5782af87-0b4f-4824-aed9-541addf429b2'] Sep 25 00:59:42.019753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 5782af87-0b4f-4824-aed9-541addf429b2 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 00:59:42.024630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:365 - port information retrieved. Elapsed:0.015 Sep 25 00:59:42.024962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:365 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Sep 25 00:59:44.011139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:366 started Sep 25 00:59:44.015260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfd3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=740000000,duration_sec=746,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:59:44.016099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:59:44.016497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:366 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 00:59:46.012469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:367 started Sep 25 00:59:46.015675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfd5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=741000000,duration_sec=748,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:59:46.016304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:59:46.016850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:367 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:59:46.545048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-cec7c135-132a-47cc-ae87-fee2a9f967aa admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:59:46Z,description='Default security group',id=620a552b-8dbf-4d17-b11a-b02de067a613,is_default=True,name='default',project_id='28dbef675166415687c9840b5ac605f1',revision_number=1,rules=[SecurityGroupRule(3b936312-ed3f-4505-82f4-eaf20c3dc3d0),SecurityGroupRule(6d94f56d-02de-4548-8aeb-0f69f708d520),SecurityGroupRule(a5c15dfd-b79a-4917-9267-9de7b8422413),SecurityGroupRule(dff13a62-0188-4452-b6f3-54e5befd0d0b)],shared=False,stateful=True,updated_at=2022-09-25T00:59:46Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:46.545532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-cec7c135-132a-47cc-ae87-fee2a9f967aa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (620a552b-8dbf-4d17-b11a-b02de067a613), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:46.546751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-cec7c135-132a-47cc-ae87-fee2a9f967aa admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:46Z,description=,direction='ingress',ethertype='IPv4',id=3b936312-ed3f-4505-82f4-eaf20c3dc3d0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='28dbef675166415687c9840b5ac605f1',protocol=,remote_address_group_id=,remote_group_id=620a552b-8dbf-4d17-b11a-b02de067a613,remote_ip_prefix=,revision_number=0,security_group_id=620a552b-8dbf-4d17-b11a-b02de067a613,updated_at=2022-09-25T00:59:46Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:46.547225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-cec7c135-132a-47cc-ae87-fee2a9f967aa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (3b936312-ed3f-4505-82f4-eaf20c3dc3d0), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:46.547567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-cec7c135-132a-47cc-ae87-fee2a9f967aa admin admin] Security group rule updated ['620a552b-8dbf-4d17-b11a-b02de067a613'] Sep 25 00:59:46.548662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-cec7c135-132a-47cc-ae87-fee2a9f967aa admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:46Z,description=,direction='ingress',ethertype='IPv6',id=6d94f56d-02de-4548-8aeb-0f69f708d520,normalized_cidr=None,port_range_max=,port_range_min=,project_id='28dbef675166415687c9840b5ac605f1',protocol=,remote_address_group_id=,remote_group_id=620a552b-8dbf-4d17-b11a-b02de067a613,remote_ip_prefix=,revision_number=0,security_group_id=620a552b-8dbf-4d17-b11a-b02de067a613,updated_at=2022-09-25T00:59:46Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:46.549028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-cec7c135-132a-47cc-ae87-fee2a9f967aa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (6d94f56d-02de-4548-8aeb-0f69f708d520), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:46.549704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-cec7c135-132a-47cc-ae87-fee2a9f967aa admin admin] Security group rule updated ['620a552b-8dbf-4d17-b11a-b02de067a613'] Sep 25 00:59:46.550478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-cec7c135-132a-47cc-ae87-fee2a9f967aa admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:46Z,description=,direction='egress',ethertype='IPv4',id=a5c15dfd-b79a-4917-9267-9de7b8422413,normalized_cidr=None,port_range_max=,port_range_min=,project_id='28dbef675166415687c9840b5ac605f1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=620a552b-8dbf-4d17-b11a-b02de067a613,updated_at=2022-09-25T00:59:46Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:46.550847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-cec7c135-132a-47cc-ae87-fee2a9f967aa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (a5c15dfd-b79a-4917-9267-9de7b8422413), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:46.551262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-cec7c135-132a-47cc-ae87-fee2a9f967aa admin admin] Security group rule updated ['620a552b-8dbf-4d17-b11a-b02de067a613'] Sep 25 00:59:46.552160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-cec7c135-132a-47cc-ae87-fee2a9f967aa admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:46Z,description=,direction='egress',ethertype='IPv6',id=dff13a62-0188-4452-b6f3-54e5befd0d0b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='28dbef675166415687c9840b5ac605f1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=620a552b-8dbf-4d17-b11a-b02de067a613,updated_at=2022-09-25T00:59:46Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:46.552559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-cec7c135-132a-47cc-ae87-fee2a9f967aa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (dff13a62-0188-4452-b6f3-54e5befd0d0b), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:46.552889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-cec7c135-132a-47cc-ae87-fee2a9f967aa admin admin] Security group rule updated ['620a552b-8dbf-4d17-b11a-b02de067a613'] Sep 25 00:59:46.718850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-24248cf2-0e51-4fae-8442-5797b500c035 admin admin] Resource SecurityGroup deleted: 620a552b-8dbf-4d17-b11a-b02de067a613 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:46.719426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-24248cf2-0e51-4fae-8442-5797b500c035 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (620a552b-8dbf-4d17-b11a-b02de067a613), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:46.719982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24248cf2-0e51-4fae-8442-5797b500c035 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('620a552b-8dbf-4d17-b11a-b02de067a613',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:59:46.732825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-24248cf2-0e51-4fae-8442-5797b500c035 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('620a552b-8dbf-4d17-b11a-b02de067a613',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:59:46.733543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-24248cf2-0e51-4fae-8442-5797b500c035 admin admin] Resource SecurityGroupRule deleted: 3b936312-ed3f-4505-82f4-eaf20c3dc3d0 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:46.734375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-24248cf2-0e51-4fae-8442-5797b500c035 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (3b936312-ed3f-4505-82f4-eaf20c3dc3d0), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:46.734778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-24248cf2-0e51-4fae-8442-5797b500c035 admin admin] Security group rule updated ['620a552b-8dbf-4d17-b11a-b02de067a613'] Sep 25 00:59:46.735112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-24248cf2-0e51-4fae-8442-5797b500c035 admin admin] Resource SecurityGroupRule deleted: 6d94f56d-02de-4548-8aeb-0f69f708d520 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:46.735483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-24248cf2-0e51-4fae-8442-5797b500c035 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (6d94f56d-02de-4548-8aeb-0f69f708d520), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:46.735796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-24248cf2-0e51-4fae-8442-5797b500c035 admin admin] Security group rule updated ['620a552b-8dbf-4d17-b11a-b02de067a613'] Sep 25 00:59:46.736175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-24248cf2-0e51-4fae-8442-5797b500c035 admin admin] Resource SecurityGroupRule deleted: a5c15dfd-b79a-4917-9267-9de7b8422413 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:46.736779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-24248cf2-0e51-4fae-8442-5797b500c035 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (a5c15dfd-b79a-4917-9267-9de7b8422413), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:46.737131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-24248cf2-0e51-4fae-8442-5797b500c035 admin admin] Security group rule updated ['620a552b-8dbf-4d17-b11a-b02de067a613'] Sep 25 00:59:46.737513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-24248cf2-0e51-4fae-8442-5797b500c035 admin admin] Resource SecurityGroupRule deleted: dff13a62-0188-4452-b6f3-54e5befd0d0b {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:46.737868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-24248cf2-0e51-4fae-8442-5797b500c035 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (dff13a62-0188-4452-b6f3-54e5befd0d0b), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:46.738187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-24248cf2-0e51-4fae-8442-5797b500c035 admin admin] Security group rule updated ['620a552b-8dbf-4d17-b11a-b02de067a613'] Sep 25 00:59:48.013436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:368 started Sep 25 00:59:48.017133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfd7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=742000000,duration_sec=750,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:59:48.018976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:59:48.019347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:368 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 00:59:50.015007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:369 started Sep 25 00:59:50.017825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfd9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=743000000,duration_sec=752,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:59:50.018404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:59:50.018759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:369 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:59:51.116275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4b7b1fcc-48d3-4a06-ae0e-ea950bbde5af tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource Port deleted: 0b0017e5-0afb-4334-8450-1d4303b0d473 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:51.117482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4b7b1fcc-48d3-4a06-ae0e-ea950bbde5af tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (0b0017e5-0afb-4334-8450-1d4303b0d473), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:51.118066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-4b7b1fcc-48d3-4a06-ae0e-ea950bbde5af tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group member updated {'85a4d961-6b69-4634-b71f-daffd4a3d47f'} Sep 25 00:59:52.016557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:370 started Sep 25 00:59:52.020319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfdb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=745000000,duration_sec=754,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:59:52.021298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:59:52.021842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:370 - starting polling. Elapsed:0.006 Sep 25 00:59:52.026569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:52.030230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 0b0017e5-0afb-4334-8450-1d4303b0d473 not present in bridge br-int Sep 25 00:59:52.030684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 00:59:52.031156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['0b0017e5-0afb-4334-8450-1d4303b0d473'] Sep 25 00:59:52.031551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 0b0017e5-0afb-4334-8450-1d4303b0d473 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 00:59:52.036451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:370 - port information retrieved. Elapsed:0.020 Sep 25 00:59:52.036797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:370 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.021 Sep 25 00:59:53.478092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7f408a4c-f263-4f91-b500-5100241bf8b5 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource SecurityGroup deleted: 85a4d961-6b69-4634-b71f-daffd4a3d47f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:53.478786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7f408a4c-f263-4f91-b500-5100241bf8b5 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (85a4d961-6b69-4634-b71f-daffd4a3d47f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:53.478889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f408a4c-f263-4f91-b500-5100241bf8b5 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('85a4d961-6b69-4634-b71f-daffd4a3d47f',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 00:59:53.498579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7f408a4c-f263-4f91-b500-5100241bf8b5 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('85a4d961-6b69-4634-b71f-daffd4a3d47f',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 00:59:53.499119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7f408a4c-f263-4f91-b500-5100241bf8b5 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource SecurityGroupRule deleted: 1b0d16bc-03fd-44b3-880d-3cf977db4e82 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:53.499682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7f408a4c-f263-4f91-b500-5100241bf8b5 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (1b0d16bc-03fd-44b3-880d-3cf977db4e82), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:53.500037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-7f408a4c-f263-4f91-b500-5100241bf8b5 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['85a4d961-6b69-4634-b71f-daffd4a3d47f'] Sep 25 00:59:53.500446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7f408a4c-f263-4f91-b500-5100241bf8b5 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource SecurityGroupRule deleted: f35ee64b-40c9-43dc-bbf2-ed1da88e1a4c {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:53.500803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7f408a4c-f263-4f91-b500-5100241bf8b5 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f35ee64b-40c9-43dc-bbf2-ed1da88e1a4c), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:53.501151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-7f408a4c-f263-4f91-b500-5100241bf8b5 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['85a4d961-6b69-4634-b71f-daffd4a3d47f'] Sep 25 00:59:53.501586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7f408a4c-f263-4f91-b500-5100241bf8b5 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource SecurityGroupRule deleted: e783e066-813d-4e48-90be-3548b3839644 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:53.501937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7f408a4c-f263-4f91-b500-5100241bf8b5 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (e783e066-813d-4e48-90be-3548b3839644), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:53.502271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-7f408a4c-f263-4f91-b500-5100241bf8b5 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['85a4d961-6b69-4634-b71f-daffd4a3d47f'] Sep 25 00:59:53.502646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7f408a4c-f263-4f91-b500-5100241bf8b5 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource SecurityGroupRule deleted: dbbc9e1c-2f1d-4d31-83f5-a6e8cc2643f2 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:53.502994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7f408a4c-f263-4f91-b500-5100241bf8b5 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (dbbc9e1c-2f1d-4d31-83f5-a6e8cc2643f2), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:53.503321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-7f408a4c-f263-4f91-b500-5100241bf8b5 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['85a4d961-6b69-4634-b71f-daffd4a3d47f'] Sep 25 00:59:53.893288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-65f60cc2-cdfd-446b-9faf-87823a5e2dc5 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource Port deleted: c677e0d1-0bfa-45ef-9888-f9884e48ddd2 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 00:59:53.893747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-65f60cc2-cdfd-446b-9faf-87823a5e2dc5 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (c677e0d1-0bfa-45ef-9888-f9884e48ddd2), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:54.017429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:371 started Sep 25 00:59:54.020960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfdd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=746000000,duration_sec=756,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:59:54.021667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:59:54.022057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:371 - starting polling. Elapsed:0.005 Sep 25 00:59:54.025496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:54.027667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port c677e0d1-0bfa-45ef-9888-f9884e48ddd2 not present in bridge br-int Sep 25 00:59:54.028005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 00:59:54.028289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['c677e0d1-0bfa-45ef-9888-f9884e48ddd2'] Sep 25 00:59:54.028614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port c677e0d1-0bfa-45ef-9888-f9884e48ddd2 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 00:59:54.034278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:371 - port information retrieved. Elapsed:0.017 Sep 25 00:59:54.034621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:371 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.018 Sep 25 00:59:54.203252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-cc23b5c2-824c-4b1d-ae3a-f71ebcf9520a tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T00:59:54Z,description='tempest-description--82340807',id=9c548fe2-c968-431e-b105-29ac3ebc5929,is_default=False,name='tempest-securitygroup--76657188',project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',revision_number=1,rules=[SecurityGroupRule(537a28c4-bbe3-4088-a915-0974be01e95f),SecurityGroupRule(e938bbfd-f8d4-4005-9620-696a43781c72)],shared=False,stateful=True,updated_at=2022-09-25T00:59:54Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:54.203642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-cc23b5c2-824c-4b1d-ae3a-f71ebcf9520a tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (9c548fe2-c968-431e-b105-29ac3ebc5929), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:54.204283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-cc23b5c2-824c-4b1d-ae3a-f71ebcf9520a tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:54Z,description=,direction='egress',ethertype='IPv6',id=537a28c4-bbe3-4088-a915-0974be01e95f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9c548fe2-c968-431e-b105-29ac3ebc5929,updated_at=2022-09-25T00:59:54Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:54.204645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-cc23b5c2-824c-4b1d-ae3a-f71ebcf9520a tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (537a28c4-bbe3-4088-a915-0974be01e95f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:54.204987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-cc23b5c2-824c-4b1d-ae3a-f71ebcf9520a tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['9c548fe2-c968-431e-b105-29ac3ebc5929'] Sep 25 00:59:54.205694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-cc23b5c2-824c-4b1d-ae3a-f71ebcf9520a tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:54Z,description=,direction='egress',ethertype='IPv4',id=e938bbfd-f8d4-4005-9620-696a43781c72,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9c548fe2-c968-431e-b105-29ac3ebc5929,updated_at=2022-09-25T00:59:54Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:54.206116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-cc23b5c2-824c-4b1d-ae3a-f71ebcf9520a tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (e938bbfd-f8d4-4005-9620-696a43781c72), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:54.206451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-cc23b5c2-824c-4b1d-ae3a-f71ebcf9520a tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['9c548fe2-c968-431e-b105-29ac3ebc5929'] Sep 25 00:59:54.327047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-206be79c-cb5f-447c-b48e-e424ee82c3d4 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:54Z,description='',direction='ingress',ethertype='IPv4',id=d04aca62-b564-4266-9fe2-7612b4ea2316,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9c548fe2-c968-431e-b105-29ac3ebc5929,updated_at=2022-09-25T00:59:54Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:54.327047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-206be79c-cb5f-447c-b48e-e424ee82c3d4 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (d04aca62-b564-4266-9fe2-7612b4ea2316), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:54.330571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-206be79c-cb5f-447c-b48e-e424ee82c3d4 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['9c548fe2-c968-431e-b105-29ac3ebc5929'] Sep 25 00:59:54.451833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6de9a887-8fd5-47d2-bffe-8edda5b49b94 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T00:59:54Z,description='',direction='ingress',ethertype='IPv4',id=01edd873-2f4f-4209-a83f-ad585bf6b6fa,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9c548fe2-c968-431e-b105-29ac3ebc5929,updated_at=2022-09-25T00:59:54Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:54.452531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6de9a887-8fd5-47d2-bffe-8edda5b49b94 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (01edd873-2f4f-4209-a83f-ad585bf6b6fa), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:54.453062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-6de9a887-8fd5-47d2-bffe-8edda5b49b94 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['9c548fe2-c968-431e-b105-29ac3ebc5929'] Sep 25 00:59:54.924707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-722cd255-2be4-47aa-bc78-63e3bc786227 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:59:54Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=ffaa118a-c7e1-431d-adf2-f9c1b1fda378,mac_address=fa:16:3e:93:78:8a,name='',network_id=62195cd6-54fa-4e24-9d47-ae0de6356ac2,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(ffaa118a-c7e1-431d-adf2-f9c1b1fda378),security_group_ids=set([]),status='N/A',updated_at=2022-09-25T00:59:54Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:54.925427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-722cd255-2be4-47aa-bc78-63e3bc786227 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (ffaa118a-c7e1-431d-adf2-f9c1b1fda378), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:55.517081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-722cd255-2be4-47aa-bc78-63e3bc786227 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource Port ffaa118a-c7e1-431d-adf2-f9c1b1fda378 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '46974619-a9e1-48bf-9c12-1079dfafcbe6'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:59:55.517494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-722cd255-2be4-47aa-bc78-63e3bc786227 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (ffaa118a-c7e1-431d-adf2-f9c1b1fda378), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:56.018484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:372 started Sep 25 00:59:56.021678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfdf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=747000000,duration_sec=758,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:59:56.022271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:59:56.022600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:372 - starting polling. Elapsed:0.004 Sep 25 00:59:56.025782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:56.032943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:372 - port information retrieved. Elapsed:0.015 Sep 25 00:59:56.033436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:372 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Sep 25 00:59:58.019925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:373 started Sep 25 00:59:58.022567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfe1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=748000000,duration_sec=760,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 00:59:58.023177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 00:59:58.023530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:373 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 00:59:58.562487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1055a2cf-70d0-47d1-8047-6dd9c95e80bc tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T00:59:58Z,data_plane_status=None,description='',device_id='e53662f0-18c6-40e1-99da-07e0065395e1',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=dc9429b9-a8b5-45cb-94af-f68e5fc7099c,mac_address=fa:16:3e:3e:f5:08,name='',network_id=5dc49b54-686c-4619-ad4c-65c72c26fd31,numa_affinity_policy=,project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(dc9429b9-a8b5-45cb-94af-f68e5fc7099c),security_group_ids=set([9c548fe2-c968-431e-b105-29ac3ebc5929]),status='DOWN',updated_at=2022-09-25T00:59:58Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 00:59:58.562975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1055a2cf-70d0-47d1-8047-6dd9c95e80bc tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (dc9429b9-a8b5-45cb-94af-f68e5fc7099c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:58.563442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1055a2cf-70d0-47d1-8047-6dd9c95e80bc tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group member updated {'9c548fe2-c968-431e-b105-29ac3ebc5929'} Sep 25 00:59:59.108146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-339a0ac4-36ce-4090-806f-2b1004d42f9c service neutron] Resource Port dc9429b9-a8b5-45cb-94af-f68e5fc7099c updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=dc9429b9-a8b5-45cb-94af-f68e5fc7099c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=dc9429b9-a8b5-45cb-94af-f68e5fc7099c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:59:59.108945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-339a0ac4-36ce-4090-806f-2b1004d42f9c service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (dc9429b9-a8b5-45cb-94af-f68e5fc7099c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 00:59:59.422602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-339a0ac4-36ce-4090-806f-2b1004d42f9c service neutron] Resource Port dc9429b9-a8b5-45cb-94af-f68e5fc7099c updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=dc9429b9-a8b5-45cb-94af-f68e5fc7099c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=dc9429b9-a8b5-45cb-94af-f68e5fc7099c,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=dc9429b9-a8b5-45cb-94af-f68e5fc7099c,segment=NetworkSegment(32553459-8243-41b9-9fc0-bae9f5646e9f),segment_id=32553459-8243-41b9-9fc0-bae9f5646e9f)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 00:59:59.423085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-339a0ac4-36ce-4090-806f-2b1004d42f9c service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (dc9429b9-a8b5-45cb-94af-f68e5fc7099c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:00.020635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:374 started Sep 25 01:00:00.025541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfe3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=750000000,duration_sec=762,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:00:00.026762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:00:00.027362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:374 - starting polling. Elapsed:0.007 Sep 25 01:00:00.035911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:00.038654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:374 - port information retrieved. Elapsed:0.018 Sep 25 01:00:00.038993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:374 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.019 Sep 25 01:00:02.021834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:375 started Sep 25 01:00:02.024753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfe5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=750000000,duration_sec=764,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:00:02.025488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:00:02.026000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:375 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:00:04.001766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port dc9429b9-a8b5-45cb-94af-f68e5fc7099c updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:00:04.002423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (dc9429b9-a8b5-45cb-94af-f68e5fc7099c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:04.023038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:376 started Sep 25 01:00:04.025705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfe7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=752000000,duration_sec=766,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:00:04.026374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:00:04.026704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:376 - starting polling. Elapsed:0.004 Sep 25 01:00:04.030479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:04.034900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:376 - port information retrieved. Elapsed:0.012 Sep 25 01:00:04.035229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:376 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 25 01:00:05.957780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port dc9429b9-a8b5-45cb-94af-f68e5fc7099c updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:00:05.958441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (dc9429b9-a8b5-45cb-94af-f68e5fc7099c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:06.023759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:377 started Sep 25 01:00:06.027091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfe9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=753000000,duration_sec=768,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:00:06.027707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:00:06.028038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:377 - starting polling. Elapsed:0.004 Sep 25 01:00:06.031944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:06.036536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:377 - port information retrieved. Elapsed:0.013 Sep 25 01:00:06.036878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:377 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 25 01:00:08.024353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:378 started Sep 25 01:00:08.027093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfeb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=753000000,duration_sec=770,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:00:08.027663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:00:08.028017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:378 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:00:10.025011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:379 started Sep 25 01:00:10.027704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfed,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=754000000,duration_sec=772,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:00:10.028384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:00:10.028961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:379 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:00:12.026653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:380 started Sep 25 01:00:12.030458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfef,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=755000000,duration_sec=774,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:00:12.031059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:00:12.031424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:380 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:00:14.027789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:381 started Sep 25 01:00:14.031275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dff1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=757000000,duration_sec=776,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:00:14.031865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:00:14.032213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:381 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:00:16.029541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:382 started Sep 25 01:00:16.032299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dff3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=758000000,duration_sec=778,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:00:16.032878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:00:16.033233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:382 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:00:18.030657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:383 started Sep 25 01:00:18.033421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dff5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=759000000,duration_sec=780,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:00:18.034004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:00:18.034360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:383 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:00:20.031394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:384 started Sep 25 01:00:20.033888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dff7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=760000000,duration_sec=782,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:00:20.034476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:00:20.034830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:384 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:00:20.955067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8a9271bd-b521-45dd-9caf-f90ac57334bd tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Resource Port deleted: 96168749-3e0f-462f-9aed-adacd4fb28c0 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:00:20.955791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8a9271bd-b521-45dd-9caf-f90ac57334bd tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (96168749-3e0f-462f-9aed-adacd4fb28c0), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:20.956438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8a9271bd-b521-45dd-9caf-f90ac57334bd tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Security group member updated {'e1c787d9-5e00-43b4-af6c-89d3769b8873'} Sep 25 01:00:22.032023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:385 started Sep 25 01:00:22.034468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dff9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=760000000,duration_sec=784,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:00:22.035263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:00:22.035605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:385 - starting polling. Elapsed:0.004 Sep 25 01:00:22.038969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:22.041316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 96168749-3e0f-462f-9aed-adacd4fb28c0 not present in bridge br-int Sep 25 01:00:22.041654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:00:22.041941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['96168749-3e0f-462f-9aed-adacd4fb28c0'] Sep 25 01:00:22.042268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 96168749-3e0f-462f-9aed-adacd4fb28c0 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:00:22.046958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:385 - port information retrieved. Elapsed:0.015 Sep 25 01:00:22.047292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:385 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Sep 25 01:00:23.618557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-19b18333-8894-4101-9ce3-204411a567cd tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Resource SecurityGroup deleted: e1c787d9-5e00-43b4-af6c-89d3769b8873 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:00:23.619223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-19b18333-8894-4101-9ce3-204411a567cd tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (e1c787d9-5e00-43b4-af6c-89d3769b8873), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:23.619633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19b18333-8894-4101-9ce3-204411a567cd tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e1c787d9-5e00-43b4-af6c-89d3769b8873',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:00:23.634391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-19b18333-8894-4101-9ce3-204411a567cd tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e1c787d9-5e00-43b4-af6c-89d3769b8873',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:00:23.634935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-19b18333-8894-4101-9ce3-204411a567cd tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Resource SecurityGroupRule deleted: a82bdaa7-d9d4-4b56-a6a8-982a80151fb0 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:00:23.635305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-19b18333-8894-4101-9ce3-204411a567cd tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (a82bdaa7-d9d4-4b56-a6a8-982a80151fb0), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:23.635638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-19b18333-8894-4101-9ce3-204411a567cd tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Security group rule updated ['e1c787d9-5e00-43b4-af6c-89d3769b8873'] Sep 25 01:00:23.636060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-19b18333-8894-4101-9ce3-204411a567cd tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Resource SecurityGroupRule deleted: ae9e1c7d-c79b-4600-bb87-8054e454fe8e {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:00:23.636412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-19b18333-8894-4101-9ce3-204411a567cd tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (ae9e1c7d-c79b-4600-bb87-8054e454fe8e), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:23.636730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-19b18333-8894-4101-9ce3-204411a567cd tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Security group rule updated ['e1c787d9-5e00-43b4-af6c-89d3769b8873'] Sep 25 01:00:23.637339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-19b18333-8894-4101-9ce3-204411a567cd tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Resource SecurityGroupRule deleted: dbbc07ab-f006-4c49-bc17-3317e1021669 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:00:23.637785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-19b18333-8894-4101-9ce3-204411a567cd tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (dbbc07ab-f006-4c49-bc17-3317e1021669), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:23.638362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-19b18333-8894-4101-9ce3-204411a567cd tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Security group rule updated ['e1c787d9-5e00-43b4-af6c-89d3769b8873'] Sep 25 01:00:23.638807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-19b18333-8894-4101-9ce3-204411a567cd tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Resource SecurityGroupRule deleted: 0ea8217a-556f-4b0c-862c-afdc35061ba9 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:00:23.639151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-19b18333-8894-4101-9ce3-204411a567cd tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (0ea8217a-556f-4b0c-862c-afdc35061ba9), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:23.639500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-19b18333-8894-4101-9ce3-204411a567cd tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Security group rule updated ['e1c787d9-5e00-43b4-af6c-89d3769b8873'] Sep 25 01:00:24.033222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-94815eb5-e3a3-428c-8f24-e0c3ed7577a4 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Resource Port deleted: 3be19e53-1051-400f-988a-21c11c99e045 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:00:24.033624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-94815eb5-e3a3-428c-8f24-e0c3ed7577a4 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (3be19e53-1051-400f-988a-21c11c99e045), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:24.034235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:386 started Sep 25 01:00:24.037072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dffb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=763000000,duration_sec=786,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:00:24.038162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:00:24.038519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:386 - starting polling. Elapsed:0.004 Sep 25 01:00:24.041627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:24.043838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 3be19e53-1051-400f-988a-21c11c99e045 not present in bridge br-int Sep 25 01:00:24.044191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:00:24.044464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['3be19e53-1051-400f-988a-21c11c99e045'] Sep 25 01:00:24.044786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 3be19e53-1051-400f-988a-21c11c99e045 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:00:24.049427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:386 - port information retrieved. Elapsed:0.015 Sep 25 01:00:24.049762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:386 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Sep 25 01:00:24.350315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-189f2a5e-5480-4340-85bf-a268403bf396 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:00:24Z,description='tempest-description--856736156',id=59958eaf-fcee-40b6-ab81-ca9d2af93f77,is_default=False,name='tempest-securitygroup--1992263861',project_id='f09655506e354c9d991f4df9a92f4086',revision_number=1,rules=[SecurityGroupRule(3d408c6a-63c2-4726-a13f-f3d325f806b7),SecurityGroupRule(fe705211-a645-4801-8aef-851b7d0ee4b2)],shared=False,stateful=True,updated_at=2022-09-25T01:00:24Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:00:24.350694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-189f2a5e-5480-4340-85bf-a268403bf396 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (59958eaf-fcee-40b6-ab81-ca9d2af93f77), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:24.351322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-189f2a5e-5480-4340-85bf-a268403bf396 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:00:24Z,description=,direction='egress',ethertype='IPv6',id=3d408c6a-63c2-4726-a13f-f3d325f806b7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f09655506e354c9d991f4df9a92f4086',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=59958eaf-fcee-40b6-ab81-ca9d2af93f77,updated_at=2022-09-25T01:00:24Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:00:24.351689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-189f2a5e-5480-4340-85bf-a268403bf396 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (3d408c6a-63c2-4726-a13f-f3d325f806b7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:24.352029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-189f2a5e-5480-4340-85bf-a268403bf396 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Security group rule updated ['59958eaf-fcee-40b6-ab81-ca9d2af93f77'] Sep 25 01:00:24.352703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-189f2a5e-5480-4340-85bf-a268403bf396 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:00:24Z,description=,direction='egress',ethertype='IPv4',id=fe705211-a645-4801-8aef-851b7d0ee4b2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f09655506e354c9d991f4df9a92f4086',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=59958eaf-fcee-40b6-ab81-ca9d2af93f77,updated_at=2022-09-25T01:00:24Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:00:24.353058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-189f2a5e-5480-4340-85bf-a268403bf396 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (fe705211-a645-4801-8aef-851b7d0ee4b2), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:24.353421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-189f2a5e-5480-4340-85bf-a268403bf396 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Security group rule updated ['59958eaf-fcee-40b6-ab81-ca9d2af93f77'] Sep 25 01:00:24.466478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-452c867f-b980-4bee-8000-80a90ec80aa3 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:00:24Z,description='',direction='ingress',ethertype='IPv4',id=2c3f0461-6574-40eb-a5c6-af3a3dd6b051,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='f09655506e354c9d991f4df9a92f4086',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=59958eaf-fcee-40b6-ab81-ca9d2af93f77,updated_at=2022-09-25T01:00:24Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:00:24.467051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-452c867f-b980-4bee-8000-80a90ec80aa3 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (2c3f0461-6574-40eb-a5c6-af3a3dd6b051), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:24.467409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-452c867f-b980-4bee-8000-80a90ec80aa3 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Security group rule updated ['59958eaf-fcee-40b6-ab81-ca9d2af93f77'] Sep 25 01:00:24.610143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-173b4021-1954-4f47-ba91-6db2c9663a0e tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:00:24Z,description='',direction='ingress',ethertype='IPv4',id=ea548c20-697f-4d73-98e5-f16868ccedcd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f09655506e354c9d991f4df9a92f4086',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=59958eaf-fcee-40b6-ab81-ca9d2af93f77,updated_at=2022-09-25T01:00:24Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:00:24.610143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-173b4021-1954-4f47-ba91-6db2c9663a0e tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (ea548c20-697f-4d73-98e5-f16868ccedcd), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:24.610143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-173b4021-1954-4f47-ba91-6db2c9663a0e tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Security group rule updated ['59958eaf-fcee-40b6-ab81-ca9d2af93f77'] Sep 25 01:00:25.039746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e1b36c25-a1f3-4be1-bb2b-91771e5ecae8 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:00:24Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=db8603ba-673f-49bc-aa77-4747b2dc666f,mac_address=fa:16:3e:bf:5e:01,name='',network_id=62195cd6-54fa-4e24-9d47-ae0de6356ac2,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(db8603ba-673f-49bc-aa77-4747b2dc666f),security_group_ids=set([]),status='N/A',updated_at=2022-09-25T01:00:24Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:00:25.040445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e1b36c25-a1f3-4be1-bb2b-91771e5ecae8 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (db8603ba-673f-49bc-aa77-4747b2dc666f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:25.390064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e1b36c25-a1f3-4be1-bb2b-91771e5ecae8 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Resource Port db8603ba-673f-49bc-aa77-4747b2dc666f updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '5c1b2b10-9041-473b-9c9b-b6cea53c79dc'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:00:25.390444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e1b36c25-a1f3-4be1-bb2b-91771e5ecae8 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (db8603ba-673f-49bc-aa77-4747b2dc666f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:26.035680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:387 started Sep 25 01:00:26.038157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dffd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=764000000,duration_sec=788,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:00:26.038737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:00:26.039077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:387 - starting polling. Elapsed:0.004 Sep 25 01:00:26.042278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:26.046794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:387 - port information retrieved. Elapsed:0.011 Sep 25 01:00:26.047135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:387 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 25 01:00:28.037357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:388 started Sep 25 01:00:28.041824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834dfff,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=766000000,duration_sec=790,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:00:28.042741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:00:28.043318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:388 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:00:28.797627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-52dd7439-3803-4b15-befd-785dabb40570 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:00:28Z,data_plane_status=None,description='',device_id='c09925bc-c9c6-4bd8-9cb1-af5bfdc55af4',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=4aef1009-d2d3-4c6f-af8a-c5134e19fa37,mac_address=fa:16:3e:06:62:c5,name='',network_id=334cdfa6-14bd-4f9b-b93c-dbd866cdb6bb,numa_affinity_policy=,project_id='f09655506e354c9d991f4df9a92f4086',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(4aef1009-d2d3-4c6f-af8a-c5134e19fa37),security_group_ids=set([59958eaf-fcee-40b6-ab81-ca9d2af93f77]),status='DOWN',updated_at=2022-09-25T01:00:28Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:00:28.798051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-52dd7439-3803-4b15-befd-785dabb40570 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (4aef1009-d2d3-4c6f-af8a-c5134e19fa37), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:28.799155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-52dd7439-3803-4b15-befd-785dabb40570 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Security group member updated {'59958eaf-fcee-40b6-ab81-ca9d2af93f77'} Sep 25 01:00:29.437829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-71b357af-5ad1-43b3-9753-2870a22bb50a service neutron] Resource Port 4aef1009-d2d3-4c6f-af8a-c5134e19fa37 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=4aef1009-d2d3-4c6f-af8a-c5134e19fa37,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=4aef1009-d2d3-4c6f-af8a-c5134e19fa37,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:00:29.438914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-71b357af-5ad1-43b3-9753-2870a22bb50a service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (4aef1009-d2d3-4c6f-af8a-c5134e19fa37), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:29.799755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-71b357af-5ad1-43b3-9753-2870a22bb50a service neutron] Resource Port 4aef1009-d2d3-4c6f-af8a-c5134e19fa37 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=4aef1009-d2d3-4c6f-af8a-c5134e19fa37,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=4aef1009-d2d3-4c6f-af8a-c5134e19fa37,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=4aef1009-d2d3-4c6f-af8a-c5134e19fa37,segment=NetworkSegment(60226fdd-ab84-4bff-9bed-5551adf26f89),segment_id=60226fdd-ab84-4bff-9bed-5551adf26f89)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:00:29.800591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-71b357af-5ad1-43b3-9753-2870a22bb50a service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (4aef1009-d2d3-4c6f-af8a-c5134e19fa37), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:30.038850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:389 started Sep 25 01:00:30.041893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e001,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=767000000,duration_sec=792,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:00:30.042479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:00:30.042847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:389 - starting polling. Elapsed:0.004 Sep 25 01:00:30.046251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:30.051078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:389 - port information retrieved. Elapsed:0.012 Sep 25 01:00:30.051430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:389 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 25 01:00:32.040099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:390 started Sep 25 01:00:32.042794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e003,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=769000000,duration_sec=794,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:00:32.044013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:00:32.044531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:390 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:00:34.041894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:391 started Sep 25 01:00:34.045950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e005,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=771000000,duration_sec=796,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:00:34.046632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:00:34.047076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:391 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:00:34.134606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 4aef1009-d2d3-4c6f-af8a-c5134e19fa37 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:00:34.135051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (4aef1009-d2d3-4c6f-af8a-c5134e19fa37), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:36.043276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:392 started Sep 25 01:00:36.047220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e007,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=772000000,duration_sec=798,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:00:36.048279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:00:36.049095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:392 - starting polling. Elapsed:0.006 Sep 25 01:00:36.053229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:36.060481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:392 - port information retrieved. Elapsed:0.017 Sep 25 01:00:36.061065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:392 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.018 Sep 25 01:00:36.208722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 4aef1009-d2d3-4c6f-af8a-c5134e19fa37 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:00:36.209169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (4aef1009-d2d3-4c6f-af8a-c5134e19fa37), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:38.044350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:393 started Sep 25 01:00:38.046993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e009,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=773000000,duration_sec=800,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:00:38.047576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:00:38.047915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:393 - starting polling. Elapsed:0.004 Sep 25 01:00:38.051149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:38.055684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:393 - port information retrieved. Elapsed:0.012 Sep 25 01:00:38.056095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:393 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 25 01:00:40.045875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:394 started Sep 25 01:00:40.049560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e00b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=775000000,duration_sec=802,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:00:40.050307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:00:40.050767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:394 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:00:42.046843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:395 started Sep 25 01:00:42.049217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e00d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=775000000,duration_sec=804,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:00:42.050049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:00:42.050407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:395 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:00:44.048598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:396 started Sep 25 01:00:44.051646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e00f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=777000000,duration_sec=806,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:00:44.052511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:00:44.052920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:396 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:00:46.049782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:397 started Sep 25 01:00:46.053528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e011,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=779000000,duration_sec=808,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:00:46.054336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:00:46.054859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:397 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:00:48.051049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:398 started Sep 25 01:00:48.053601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e013,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=779000000,duration_sec=810,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:00:48.054211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:00:48.054623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:398 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:00:50.052832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:399 started Sep 25 01:00:50.055926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e015,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=782000000,duration_sec=812,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:00:50.056603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:00:50.056966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:399 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:00:52.054410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:400 started Sep 25 01:00:52.057550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e017,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=783000000,duration_sec=814,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:00:52.058942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:00:52.059218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:400 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:00:54.055911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:401 started Sep 25 01:00:54.060607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e019,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=785000000,duration_sec=816,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:00:54.061287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:00:54.061700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:401 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:00:56.057208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:402 started Sep 25 01:00:56.061047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e01b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=787000000,duration_sec=818,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:00:56.061685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:00:56.062045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:402 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:00:58.059312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:403 started Sep 25 01:00:58.072496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e01d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=788000000,duration_sec=820,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:00:58.072988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:00:58.074803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:403 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Sep 25 01:00:59.021916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0a88ff25-a2e7-4243-83f6-1c05c8f6fc91 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Resource Port deleted: a554103e-40f9-42b8-b04a-4fc7d8888240 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:00:59.022521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0a88ff25-a2e7-4243-83f6-1c05c8f6fc91 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (a554103e-40f9-42b8-b04a-4fc7d8888240), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:00:59.023189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-0a88ff25-a2e7-4243-83f6-1c05c8f6fc91 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Security group member updated {'eeea7474-c761-4d5f-be6e-c79f9aedf9b8'} Sep 25 01:01:00.060791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:404 started Sep 25 01:01:00.066822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e01f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=790000000,duration_sec=822,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:00.067754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:01:00.068228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:404 - starting polling. Elapsed:0.008 Sep 25 01:01:00.073110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:00.075990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port a554103e-40f9-42b8-b04a-4fc7d8888240 not present in bridge br-int Sep 25 01:01:00.076358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:01:00.076669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['a554103e-40f9-42b8-b04a-4fc7d8888240'] Sep 25 01:01:00.077000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port a554103e-40f9-42b8-b04a-4fc7d8888240 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:01:00.082002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:404 - port information retrieved. Elapsed:0.021 Sep 25 01:01:00.082491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:404 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.022 Sep 25 01:01:00.888241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-166a28fa-9733-4baf-9898-7b416b0dacb8 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Resource SecurityGroup deleted: eeea7474-c761-4d5f-be6e-c79f9aedf9b8 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:00.889059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-166a28fa-9733-4baf-9898-7b416b0dacb8 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (eeea7474-c761-4d5f-be6e-c79f9aedf9b8), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:00.889904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-166a28fa-9733-4baf-9898-7b416b0dacb8 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('eeea7474-c761-4d5f-be6e-c79f9aedf9b8',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:01:00.968245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-166a28fa-9733-4baf-9898-7b416b0dacb8 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('eeea7474-c761-4d5f-be6e-c79f9aedf9b8',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:01:00.968551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-166a28fa-9733-4baf-9898-7b416b0dacb8 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Resource SecurityGroupRule deleted: 6909a534-ff48-4169-ab61-0e2f22bfdc61 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:00.968983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-166a28fa-9733-4baf-9898-7b416b0dacb8 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (6909a534-ff48-4169-ab61-0e2f22bfdc61), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:00.969557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-166a28fa-9733-4baf-9898-7b416b0dacb8 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Security group rule updated ['eeea7474-c761-4d5f-be6e-c79f9aedf9b8'] Sep 25 01:01:00.970233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-166a28fa-9733-4baf-9898-7b416b0dacb8 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Resource SecurityGroupRule deleted: b3943ffe-bfb9-4fb3-90cb-737091f41c07 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:00.970737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-166a28fa-9733-4baf-9898-7b416b0dacb8 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (b3943ffe-bfb9-4fb3-90cb-737091f41c07), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:00.971068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-166a28fa-9733-4baf-9898-7b416b0dacb8 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Security group rule updated ['eeea7474-c761-4d5f-be6e-c79f9aedf9b8'] Sep 25 01:01:00.971756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-166a28fa-9733-4baf-9898-7b416b0dacb8 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Resource SecurityGroupRule deleted: 9b5e3393-9aff-42f6-874f-3fc019fd7fe4 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:00.972397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-166a28fa-9733-4baf-9898-7b416b0dacb8 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (9b5e3393-9aff-42f6-874f-3fc019fd7fe4), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:00.972955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-166a28fa-9733-4baf-9898-7b416b0dacb8 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Security group rule updated ['eeea7474-c761-4d5f-be6e-c79f9aedf9b8'] Sep 25 01:01:00.973391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-166a28fa-9733-4baf-9898-7b416b0dacb8 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Resource SecurityGroupRule deleted: 29fddec4-055c-449d-b13b-a09963536b0a {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:00.973760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-166a28fa-9733-4baf-9898-7b416b0dacb8 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (29fddec4-055c-449d-b13b-a09963536b0a), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:00.974171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-166a28fa-9733-4baf-9898-7b416b0dacb8 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Security group rule updated ['eeea7474-c761-4d5f-be6e-c79f9aedf9b8'] Sep 25 01:01:01.401790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4b121bfb-b526-4098-8ae2-190cb184983c tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Resource Port deleted: 17a80ba6-c081-4c9d-a08c-8d5766a6f9f1 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:01.402873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4b121bfb-b526-4098-8ae2-190cb184983c tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (17a80ba6-c081-4c9d-a08c-8d5766a6f9f1), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:02.062196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:405 started Sep 25 01:01:02.065647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e021,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=791000000,duration_sec=824,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:02.066944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:01:02.067400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:405 - starting polling. Elapsed:0.005 Sep 25 01:01:02.070981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:02.073543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 17a80ba6-c081-4c9d-a08c-8d5766a6f9f1 not present in bridge br-int Sep 25 01:01:02.074062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:01:02.074475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['17a80ba6-c081-4c9d-a08c-8d5766a6f9f1'] Sep 25 01:01:02.074937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 17a80ba6-c081-4c9d-a08c-8d5766a6f9f1 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:01:02.079722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:405 - port information retrieved. Elapsed:0.018 Sep 25 01:01:02.080162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:405 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.018 Sep 25 01:01:04.063702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:406 started Sep 25 01:01:04.069377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e023,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=793000000,duration_sec=826,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:04.070469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:01:04.071052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:406 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 25 01:01:04.678187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c3be6bfa-3815-463a-b636-2973c3296b1d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Resource Port 0940e2bc-bbba-4cec-82c5-38b72d995723 updated (revision_number 6->7). Old fields: {'security_group_ids': CoercedSet({'5820ec3a-8d2a-47c6-8b82-59a1dad211f3', '42581346-2174-404e-9723-a7e42899addf'})} New fields: {'security_group_ids': CoercedSet({'5820ec3a-8d2a-47c6-8b82-59a1dad211f3'})} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:01:04.679139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c3be6bfa-3815-463a-b636-2973c3296b1d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (0940e2bc-bbba-4cec-82c5-38b72d995723), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:04.680227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c3be6bfa-3815-463a-b636-2973c3296b1d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Security group member updated {'5820ec3a-8d2a-47c6-8b82-59a1dad211f3', '42581346-2174-404e-9723-a7e42899addf'} Sep 25 01:01:04.885744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-86ace536-21cf-4484-94aa-8834ed6aad9d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Resource SecurityGroup deleted: 42581346-2174-404e-9723-a7e42899addf {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:04.886469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-86ace536-21cf-4484-94aa-8834ed6aad9d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (42581346-2174-404e-9723-a7e42899addf), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:04.888714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86ace536-21cf-4484-94aa-8834ed6aad9d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('42581346-2174-404e-9723-a7e42899addf',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:01:04.945320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-86ace536-21cf-4484-94aa-8834ed6aad9d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('42581346-2174-404e-9723-a7e42899addf',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:01:04.946439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-86ace536-21cf-4484-94aa-8834ed6aad9d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Resource SecurityGroupRule deleted: 0618770f-c33d-46a3-80cc-a268b293a7ff {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:04.946908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-86ace536-21cf-4484-94aa-8834ed6aad9d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (0618770f-c33d-46a3-80cc-a268b293a7ff), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:04.947532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-86ace536-21cf-4484-94aa-8834ed6aad9d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Security group rule updated ['42581346-2174-404e-9723-a7e42899addf'] Sep 25 01:01:04.948428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-86ace536-21cf-4484-94aa-8834ed6aad9d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Resource SecurityGroupRule deleted: 4f035256-e6fb-4f3a-8fb8-1b73fe110b2c {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:04.949345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-86ace536-21cf-4484-94aa-8834ed6aad9d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (4f035256-e6fb-4f3a-8fb8-1b73fe110b2c), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:04.950032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-86ace536-21cf-4484-94aa-8834ed6aad9d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Security group rule updated ['42581346-2174-404e-9723-a7e42899addf'] Sep 25 01:01:04.950469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-86ace536-21cf-4484-94aa-8834ed6aad9d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Resource SecurityGroupRule deleted: f150cc34-473b-40cc-8bb0-c0dbc4779baf {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:04.950832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-86ace536-21cf-4484-94aa-8834ed6aad9d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f150cc34-473b-40cc-8bb0-c0dbc4779baf), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:04.951286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-86ace536-21cf-4484-94aa-8834ed6aad9d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Security group rule updated ['42581346-2174-404e-9723-a7e42899addf'] Sep 25 01:01:04.951785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-86ace536-21cf-4484-94aa-8834ed6aad9d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Resource SecurityGroupRule deleted: 142c49b6-4fd3-4318-9135-08fabbd60f4e {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:04.952144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-86ace536-21cf-4484-94aa-8834ed6aad9d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (142c49b6-4fd3-4318-9135-08fabbd60f4e), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:04.952740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-86ace536-21cf-4484-94aa-8834ed6aad9d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Security group rule updated ['42581346-2174-404e-9723-a7e42899addf'] Sep 25 01:01:04.953245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-86ace536-21cf-4484-94aa-8834ed6aad9d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Resource SecurityGroupRule deleted: a8823e8f-f721-42f1-83a2-ff21e8a05ad4 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:04.953706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-86ace536-21cf-4484-94aa-8834ed6aad9d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (a8823e8f-f721-42f1-83a2-ff21e8a05ad4), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:04.954112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-86ace536-21cf-4484-94aa-8834ed6aad9d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Security group rule updated ['42581346-2174-404e-9723-a7e42899addf'] Sep 25 01:01:04.954592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-86ace536-21cf-4484-94aa-8834ed6aad9d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Resource SecurityGroupRule deleted: f9730db3-f249-4de5-b45f-0afa428b03dd {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:04.955041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-86ace536-21cf-4484-94aa-8834ed6aad9d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f9730db3-f249-4de5-b45f-0afa428b03dd), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:04.955537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-86ace536-21cf-4484-94aa-8834ed6aad9d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Security group rule updated ['42581346-2174-404e-9723-a7e42899addf'] Sep 25 01:01:04.955935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-86ace536-21cf-4484-94aa-8834ed6aad9d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Resource SecurityGroupRule deleted: 4ec650d0-9e1c-41f7-9f70-9494e09c94d7 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:04.956329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-86ace536-21cf-4484-94aa-8834ed6aad9d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (4ec650d0-9e1c-41f7-9f70-9494e09c94d7), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:04.956653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-86ace536-21cf-4484-94aa-8834ed6aad9d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Security group rule updated ['42581346-2174-404e-9723-a7e42899addf'] Sep 25 01:01:04.957036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-86ace536-21cf-4484-94aa-8834ed6aad9d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Resource SecurityGroupRule deleted: 043a5495-adb6-4b83-8724-e65c69edb600 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:04.957450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-86ace536-21cf-4484-94aa-8834ed6aad9d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (043a5495-adb6-4b83-8724-e65c69edb600), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:04.957873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-86ace536-21cf-4484-94aa-8834ed6aad9d tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Security group rule updated ['42581346-2174-404e-9723-a7e42899addf'] Sep 25 01:01:05.572396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ef741283-8b44-462a-a6cd-1323532a98c2 tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Resource Port deleted: fcf9514b-30ed-4617-ba23-6d05a475dfb7 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:05.573602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ef741283-8b44-462a-a6cd-1323532a98c2 tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (fcf9514b-30ed-4617-ba23-6d05a475dfb7), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:06.064070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:407 started Sep 25 01:01:06.067422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e025,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=792000000,duration_sec=828,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:06.068136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:01:06.068554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:407 - starting polling. Elapsed:0.005 Sep 25 01:01:06.072040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:06.075024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port fcf9514b-30ed-4617-ba23-6d05a475dfb7 not present in bridge br-int Sep 25 01:01:06.075405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:01:06.075655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['fcf9514b-30ed-4617-ba23-6d05a475dfb7'] Sep 25 01:01:06.076046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port fcf9514b-30ed-4617-ba23-6d05a475dfb7 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:01:06.080620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:407 - port information retrieved. Elapsed:0.017 Sep 25 01:01:06.080969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:407 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Sep 25 01:01:07.977785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-82148e58-d7c4-4e76-8680-0b054ccf709a tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Resource Port deleted: 344eed51-ca03-4da0-b7a1-415ff8227472 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:07.979345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-82148e58-d7c4-4e76-8680-0b054ccf709a tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (344eed51-ca03-4da0-b7a1-415ff8227472), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:07.979984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-82148e58-d7c4-4e76-8680-0b054ccf709a tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Security group member updated {'228a413f-3378-42d6-84fd-cf375d775113'} Sep 25 01:01:08.065007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:408 started Sep 25 01:01:08.069085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e027,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=795000000,duration_sec=830,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:08.070166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:01:08.070762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:408 - starting polling. Elapsed:0.006 Sep 25 01:01:08.074609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:08.084664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 344eed51-ca03-4da0-b7a1-415ff8227472 not present in bridge br-int Sep 25 01:01:08.086382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:01:08.098917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['344eed51-ca03-4da0-b7a1-415ff8227472'] Sep 25 01:01:08.106328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 344eed51-ca03-4da0-b7a1-415ff8227472 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:01:08.115797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:408 - port information retrieved. Elapsed:0.051 Sep 25 01:01:08.121854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:408 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.051 Sep 25 01:01:10.073914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:409 started Sep 25 01:01:10.077383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e029,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=802000000,duration_sec=832,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:10.079905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:01:10.081513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:409 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 25 01:01:12.074100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:410 started Sep 25 01:01:12.077470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e02b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=803000000,duration_sec=834,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:12.078209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:01:12.078632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:410 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:01:14.075134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:411 started Sep 25 01:01:14.079629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e02d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=804000000,duration_sec=836,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:14.081007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:01:14.081725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:411 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 01:01:16.076253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:412 started Sep 25 01:01:16.079566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e02f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=805000000,duration_sec=838,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:16.080425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:01:16.080966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:412 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:01:18.077232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:413 started Sep 25 01:01:18.079879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e031,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=806000000,duration_sec=840,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:18.080575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:01:18.081014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:413 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:01:19.990550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-00f2c6ea-85c5-427e-89ec-e0673b4ff584 tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Resource Port deleted: 0940e2bc-bbba-4cec-82c5-38b72d995723 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:19.992493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-00f2c6ea-85c5-427e-89ec-e0673b4ff584 tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (0940e2bc-bbba-4cec-82c5-38b72d995723), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:19.993605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-00f2c6ea-85c5-427e-89ec-e0673b4ff584 tempest-TestMinimumBasicScenario-178748133 tempest-TestMinimumBasicScenario-178748133-project] Security group member updated {'5820ec3a-8d2a-47c6-8b82-59a1dad211f3'} Sep 25 01:01:20.072997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-737764db-20a6-47f7-9451-d9b964b73a92 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Resource Port deleted: 1f1b4ee1-4f64-49a9-bb20-210b866dfbd5 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:20.074912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-737764db-20a6-47f7-9451-d9b964b73a92 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (1f1b4ee1-4f64-49a9-bb20-210b866dfbd5), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:20.075934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-737764db-20a6-47f7-9451-d9b964b73a92 tempest-ServerRescueNegativeTestJSON-1085047793 tempest-ServerRescueNegativeTestJSON-1085047793-project] Security group member updated {'228a413f-3378-42d6-84fd-cf375d775113'} Sep 25 01:01:20.078400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:414 started Sep 25 01:01:20.081283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e033,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=807000000,duration_sec=842,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:20.082185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:01:20.082755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:414 - starting polling. Elapsed:0.004 Sep 25 01:01:20.086674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:20.089774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 0940e2bc-bbba-4cec-82c5-38b72d995723 not present in bridge br-int Sep 25 01:01:20.090200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:01:20.092428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 1f1b4ee1-4f64-49a9-bb20-210b866dfbd5 not present in bridge br-int Sep 25 01:01:20.093042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:01:20.093981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['0940e2bc-bbba-4cec-82c5-38b72d995723', '1f1b4ee1-4f64-49a9-bb20-210b866dfbd5'] Sep 25 01:01:20.095021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 0940e2bc-bbba-4cec-82c5-38b72d995723 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:01:20.095624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 1f1b4ee1-4f64-49a9-bb20-210b866dfbd5 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:01:20.101091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:414 - port information retrieved. Elapsed:0.023 Sep 25 01:01:20.101485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:414 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.023 Sep 25 01:01:20.227790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9d1325f1-5022-4c45-b6d8-6c890c815864 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource Port deleted: dc9429b9-a8b5-45cb-94af-f68e5fc7099c {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:20.230036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9d1325f1-5022-4c45-b6d8-6c890c815864 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (dc9429b9-a8b5-45cb-94af-f68e5fc7099c), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:20.231080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9d1325f1-5022-4c45-b6d8-6c890c815864 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group member updated {'9c548fe2-c968-431e-b105-29ac3ebc5929'} Sep 25 01:01:21.676795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a875ccbe-c126-41c4-a8a3-0750869c6454 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Resource Port deleted: 2d8c367e-4bc1-45e8-8730-7a0f3f231689 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:21.677617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a875ccbe-c126-41c4-a8a3-0750869c6454 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (2d8c367e-4bc1-45e8-8730-7a0f3f231689), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:21.677617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a875ccbe-c126-41c4-a8a3-0750869c6454 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Security group member updated {'0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c'} Sep 25 01:01:22.079688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:415 started Sep 25 01:01:22.084576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e035,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=809000000,duration_sec=844,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:22.086067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:01:22.086643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:415 - starting polling. Elapsed:0.007 Sep 25 01:01:22.098504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:22.104746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port dc9429b9-a8b5-45cb-94af-f68e5fc7099c not present in bridge br-int Sep 25 01:01:22.106367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:01:22.111461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 2d8c367e-4bc1-45e8-8730-7a0f3f231689 not present in bridge br-int Sep 25 01:01:22.112519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:01:22.113244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['2d8c367e-4bc1-45e8-8730-7a0f3f231689', 'dc9429b9-a8b5-45cb-94af-f68e5fc7099c'] Sep 25 01:01:22.114047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 2d8c367e-4bc1-45e8-8730-7a0f3f231689 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:01:22.114782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port dc9429b9-a8b5-45cb-94af-f68e5fc7099c is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:01:22.125708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:415 - port information retrieved. Elapsed:0.046 Sep 25 01:01:22.126669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:415 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.047 Sep 25 01:01:23.460094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d2016941-a8f9-45ad-a04e-5b51548095d9 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource SecurityGroup deleted: 9c548fe2-c968-431e-b105-29ac3ebc5929 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:23.461507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d2016941-a8f9-45ad-a04e-5b51548095d9 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (9c548fe2-c968-431e-b105-29ac3ebc5929), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:23.462451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2016941-a8f9-45ad-a04e-5b51548095d9 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('9c548fe2-c968-431e-b105-29ac3ebc5929',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:01:23.574862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d2016941-a8f9-45ad-a04e-5b51548095d9 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('9c548fe2-c968-431e-b105-29ac3ebc5929',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:01:23.576640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d2016941-a8f9-45ad-a04e-5b51548095d9 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource SecurityGroupRule deleted: 537a28c4-bbe3-4088-a915-0974be01e95f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:23.577479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d2016941-a8f9-45ad-a04e-5b51548095d9 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (537a28c4-bbe3-4088-a915-0974be01e95f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:23.578135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d2016941-a8f9-45ad-a04e-5b51548095d9 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['9c548fe2-c968-431e-b105-29ac3ebc5929'] Sep 25 01:01:23.579014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d2016941-a8f9-45ad-a04e-5b51548095d9 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource SecurityGroupRule deleted: e938bbfd-f8d4-4005-9620-696a43781c72 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:23.579765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d2016941-a8f9-45ad-a04e-5b51548095d9 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (e938bbfd-f8d4-4005-9620-696a43781c72), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:23.580213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d2016941-a8f9-45ad-a04e-5b51548095d9 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['9c548fe2-c968-431e-b105-29ac3ebc5929'] Sep 25 01:01:23.582258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d2016941-a8f9-45ad-a04e-5b51548095d9 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource SecurityGroupRule deleted: d04aca62-b564-4266-9fe2-7612b4ea2316 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:23.586192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d2016941-a8f9-45ad-a04e-5b51548095d9 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (d04aca62-b564-4266-9fe2-7612b4ea2316), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:23.586710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d2016941-a8f9-45ad-a04e-5b51548095d9 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['9c548fe2-c968-431e-b105-29ac3ebc5929'] Sep 25 01:01:23.588201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d2016941-a8f9-45ad-a04e-5b51548095d9 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource SecurityGroupRule deleted: 01edd873-2f4f-4209-a83f-ad585bf6b6fa {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:23.591761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d2016941-a8f9-45ad-a04e-5b51548095d9 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (01edd873-2f4f-4209-a83f-ad585bf6b6fa), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:23.592788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d2016941-a8f9-45ad-a04e-5b51548095d9 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['9c548fe2-c968-431e-b105-29ac3ebc5929'] Sep 25 01:01:24.080320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:416 started Sep 25 01:01:24.083411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e037,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=809000000,duration_sec=846,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:24.084496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:01:24.085031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:416 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:01:24.612680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5245dfe7-7e0a-4635-b856-08c95bdb6d38 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource Port deleted: ffaa118a-c7e1-431d-adf2-f9c1b1fda378 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:24.613724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5245dfe7-7e0a-4635-b856-08c95bdb6d38 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (ffaa118a-c7e1-431d-adf2-f9c1b1fda378), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:24.896046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-93c17466-64d9-4e8d-b919-44c1fc18ac42 admin admin] Resource Port deleted: 1b8115fa-df9f-4b13-830a-866086f1b68f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:24.897187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-93c17466-64d9-4e8d-b919-44c1fc18ac42 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (1b8115fa-df9f-4b13-830a-866086f1b68f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:25.464113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5e550f88-c119-41d9-b397-668d813098d9 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:01:25Z,description='tempest-description--1605868321',id=02453046-f588-47d0-980a-e2cdbf9b7e63,is_default=False,name='tempest-securitygroup--399920501',project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',revision_number=1,rules=[SecurityGroupRule(305bb5ce-7e2c-47f2-b76f-de23830a3b95),SecurityGroupRule(ca539ce3-1b3b-44aa-9b11-e41d03b3d698)],shared=False,stateful=True,updated_at=2022-09-25T01:01:25Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:25.464560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5e550f88-c119-41d9-b397-668d813098d9 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (02453046-f588-47d0-980a-e2cdbf9b7e63), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:25.465221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5e550f88-c119-41d9-b397-668d813098d9 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:01:25Z,description=,direction='egress',ethertype='IPv6',id=305bb5ce-7e2c-47f2-b76f-de23830a3b95,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=02453046-f588-47d0-980a-e2cdbf9b7e63,updated_at=2022-09-25T01:01:25Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:25.465624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5e550f88-c119-41d9-b397-668d813098d9 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (305bb5ce-7e2c-47f2-b76f-de23830a3b95), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:25.465991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5e550f88-c119-41d9-b397-668d813098d9 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['02453046-f588-47d0-980a-e2cdbf9b7e63'] Sep 25 01:01:25.466743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5e550f88-c119-41d9-b397-668d813098d9 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:01:25Z,description=,direction='egress',ethertype='IPv4',id=ca539ce3-1b3b-44aa-9b11-e41d03b3d698,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=02453046-f588-47d0-980a-e2cdbf9b7e63,updated_at=2022-09-25T01:01:25Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:25.467419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5e550f88-c119-41d9-b397-668d813098d9 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (ca539ce3-1b3b-44aa-9b11-e41d03b3d698), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:25.467419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5e550f88-c119-41d9-b397-668d813098d9 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['02453046-f588-47d0-980a-e2cdbf9b7e63'] Sep 25 01:01:26.082085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:417 started Sep 25 01:01:26.087374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e039,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=812000000,duration_sec=848,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:26.089025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:01:26.090547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:417 - starting polling. Elapsed:0.008 Sep 25 01:01:26.100688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:26.111837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port ffaa118a-c7e1-431d-adf2-f9c1b1fda378 not present in bridge br-int Sep 25 01:01:26.116974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:01:26.135614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-1b8115fa-df, col_values=(('tag', 4095),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:01:26.161587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e03b,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 13}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:26.162639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['ffaa118a-c7e1-431d-adf2-f9c1b1fda378', '1b8115fa-df9f-4b13-830a-866086f1b68f'] Sep 25 01:01:26.163417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port ffaa118a-c7e1-431d-adf2-f9c1b1fda378 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:01:26.164972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 4 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:01:26.243012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb28ae7-85b2-4a90-a7ea-e78aaf7769ae]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:01:26.258742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:417 - port information retrieved. Elapsed:0.177 Sep 25 01:01:26.260516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:417 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.178 Sep 25 01:01:26.328627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-916679c3-3e48-4b81-bf60-412afcf905da tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:01:26Z,description='',direction='ingress',ethertype='IPv4',id=bee06c7e-ffa8-4455-9e6c-370d95c180cb,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=02453046-f588-47d0-980a-e2cdbf9b7e63,updated_at=2022-09-25T01:01:26Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:26.330381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-916679c3-3e48-4b81-bf60-412afcf905da tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (bee06c7e-ffa8-4455-9e6c-370d95c180cb), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:26.331298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-916679c3-3e48-4b81-bf60-412afcf905da tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['02453046-f588-47d0-980a-e2cdbf9b7e63'] Sep 25 01:01:26.736228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2d586b3a-d0a0-48b0-8d78-505b51ee987b tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:01:26Z,description='',direction='ingress',ethertype='IPv4',id=a3e6fa55-e72f-446b-a5d0-3e3f68aab6e3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=02453046-f588-47d0-980a-e2cdbf9b7e63,updated_at=2022-09-25T01:01:26Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:26.739148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2d586b3a-d0a0-48b0-8d78-505b51ee987b tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (a3e6fa55-e72f-446b-a5d0-3e3f68aab6e3), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:26.739918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2d586b3a-d0a0-48b0-8d78-505b51ee987b tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['02453046-f588-47d0-980a-e2cdbf9b7e63'] Sep 25 01:01:26.897205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8b20ad10-737c-4e57-9643-1a1196f792f9","delete","qr-1b8115fa-df",13,["map",[["attached-mac","fa:16:3e:04:63:4a"],["iface-id","1b8115fa-df9f-4b13-830a-866086f1b68f"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:01:27.018075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d73fc5ef-893c-45cb-8b5c-767f81f3409f admin admin] Resource Port deleted: c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:27.034392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d73fc5ef-893c-45cb-8b5c-767f81f3409f admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:27.343060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["93298607-c556-4163-b1f8-95044cb36979","delete","qg-7d521366-e6",15,["map",[["attached-mac","fa:16:3e:10:d9:d3"],["iface-id","7d521366-e68f-48bd-a7a8-e2283117a2b7"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:01:27.606625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b8847d64-2369-4ec4-92cc-3c7f0b5c8867 admin admin] Resource Port deleted: 7d521366-e68f-48bd-a7a8-e2283117a2b7 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:27.607722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b8847d64-2369-4ec4-92cc-3c7f0b5c8867 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (7d521366-e68f-48bd-a7a8-e2283117a2b7), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:28.084660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:418 started Sep 25 01:01:28.091825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e03d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=813000000,duration_sec=850,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:28.093047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:01:28.093822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:418 - starting polling. Elapsed:0.010 Sep 25 01:01:28.100720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:28.114638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-c9cc5d17-94, col_values=(('tag', 4095),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:01:28.139207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e03f,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 25}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:28.145933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2'] Sep 25 01:01:28.146893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 4 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:01:28.267562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8072d43f-dd19-4c89-8813-f13f6c6fc6df]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:01:28.275762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e041,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 13}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:28.279156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e043,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 15}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:28.283589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:418 - port information retrieved. Elapsed:0.195 Sep 25 01:01:28.284345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '68a3f405-e599-4339-b2a8-058311132e20', '223185f3-b5c4-4c49-9934-15eec28454bf', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', 'ce1017e5-9b95-4c64-a292-cd0bafd98099', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2', '312a0875-9d08-4c94-b6f3-3135500afa6a', 'd4dca6ad-037a-430a-80c1-dd62be445e07', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '4a688d1f-1335-463f-b319-bcba153c442f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'c41e83db-31a6-4fd6-a328-2ef3b504c9c3', '078c0e3b-64fa-4b32-9903-3d2ac504d9d4', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'de4727a2-569d-44c6-a53e-ecc89817f610'}, 'added': set(), 'removed': {'1b8115fa-df9f-4b13-830a-866086f1b68f', '7d521366-e68f-48bd-a7a8-e2283117a2b7'}, 'updated': set(), 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:01:28.284702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:418 - agent port security group processed in 0.000 Sep 25 01:01:28.303696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up [] and devices down [] completed. Sep 25 01:01:28.304464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for {'1b8115fa-df9f-4b13-830a-866086f1b68f', '7d521366-e68f-48bd-a7a8-e2283117a2b7'} Sep 25 01:01:28.304464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 1b8115fa-df9f-4b13-830a-866086f1b68f is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:01:28.304936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 4 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:01:28.424255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ed96d3-aad7-47f8-90de-3d5d6c80e2e2]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:01:28.425898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Ports {'1b8115fa-df9f-4b13-830a-866086f1b68f', '7d521366-e68f-48bd-a7a8-e2283117a2b7'} removed Sep 25 01:01:28.660250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port removal failed for set() {{(pid=107261) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 25 01:01:28.661247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:01:28.662311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:418 - treat_devices_removed completed in 0.358 Sep 25 01:01:28.663769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:418 - ports processed. Elapsed:0.579 Sep 25 01:01:28.664669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:418 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.580 Sep 25 01:01:28.677010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-29c99dd7-69ee-4ed7-9765-37fbbaba49b3 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:01:27Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=6d04309b-156a-47f4-98a2-5f2787c74a4a,mac_address=fa:16:3e:e9:28:a3,name='',network_id=62195cd6-54fa-4e24-9d47-ae0de6356ac2,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(6d04309b-156a-47f4-98a2-5f2787c74a4a),security_group_ids=set([]),status='N/A',updated_at=2022-09-25T01:01:27Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:28.678250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-29c99dd7-69ee-4ed7-9765-37fbbaba49b3 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (6d04309b-156a-47f4-98a2-5f2787c74a4a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:29.020789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["7cfb49b5-dad8-486b-8eae-9261115e5e95","delete","qr-c9cc5d17-94",25,["map",[["attached-mac","fa:16:3e:e4:77:a7"],["iface-id","c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:01:29.109690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0323c6a6-291d-4713-b05f-f06ed90a3615 admin admin] Resource Subnet deleted: 6474d219-e5a1-4a6c-8e41-4afa0ca3d765 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:29.109991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0323c6a6-291d-4713-b05f-f06ed90a3615 admin admin] Publish callbacks [] for Subnet (6474d219-e5a1-4a6c-8e41-4afa0ca3d765), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:29.136733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b9fa04e2-30ac-488d-a291-adbbb27f022a admin admin] Resource Port deleted: c41e83db-31a6-4fd6-a328-2ef3b504c9c3 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:29.138227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b9fa04e2-30ac-488d-a291-adbbb27f022a admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (c41e83db-31a6-4fd6-a328-2ef3b504c9c3), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:29.461579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["1e370af9-1b91-4b6e-8ff4-f140cea017df","delete","tap68a3f405-e5",10,["map",[["attached-mac","fa:16:3e:34:39:6a"],["iface-id","68a3f405-e599-4339-b2a8-058311132e20"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:01:29.639155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["be4d390f-71c4-4f2f-9612-a73c842f3514","delete","qg-c41e83db-31",26,["map",[["attached-mac","fa:16:3e:b4:23:a7"],["iface-id","c41e83db-31a6-4fd6-a328-2ef3b504c9c3"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:01:29.964558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-29c99dd7-69ee-4ed7-9765-37fbbaba49b3 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource Port 6d04309b-156a-47f4-98a2-5f2787c74a4a updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '42c3925b-9217-4345-b138-d58e0658e81a'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:01:29.965098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-29c99dd7-69ee-4ed7-9765-37fbbaba49b3 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (6d04309b-156a-47f4-98a2-5f2787c74a4a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:30.086442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:419 started Sep 25 01:01:30.120522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e7c33a20-dc33-4634-a7ae-0e2d43b4634a None None] Resource Port deleted: 68a3f405-e599-4339-b2a8-058311132e20 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:30.121383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e7c33a20-dc33-4634-a7ae-0e2d43b4634a None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (68a3f405-e599-4339-b2a8-058311132e20), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:30.148627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-65c8306c-4d67-4e61-afe0-7b6ad36ea91b admin admin] Resource Port deleted: 68a3f405-e599-4339-b2a8-058311132e20 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:30.151962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-65c8306c-4d67-4e61-afe0-7b6ad36ea91b admin admin] Skipped duplicate delete event for 68a3f405-e599-4339-b2a8-058311132e20 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 25 01:01:30.168692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-50612d04-4237-4c8e-90c2-538dbdcf6b66 admin admin] Resource Subnet deleted: d74e111d-e663-49eb-9c15-00f7b719c28d {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:30.169066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-50612d04-4237-4c8e-90c2-538dbdcf6b66 admin admin] Publish callbacks [] for Subnet (d74e111d-e663-49eb-9c15-00f7b719c28d), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:30.170658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e045,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=864000000,duration_sec=852,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:30.171718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:01:30.172433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:419 - starting polling. Elapsed:0.086 Sep 25 01:01:30.199018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:30.244857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e047,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 25}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:30.262208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e049,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 10}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:30.267404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e04b,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 26}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:30.267975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:419 - port information retrieved. Elapsed:0.182 Sep 25 01:01:30.268542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '223185f3-b5c4-4c49-9934-15eec28454bf', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', 'ce1017e5-9b95-4c64-a292-cd0bafd98099', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', '312a0875-9d08-4c94-b6f3-3135500afa6a', 'd4dca6ad-037a-430a-80c1-dd62be445e07', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '4a688d1f-1335-463f-b319-bcba153c442f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', '078c0e3b-64fa-4b32-9903-3d2ac504d9d4', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'de4727a2-569d-44c6-a53e-ecc89817f610'}, 'added': set(), 'removed': {'c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2', 'c41e83db-31a6-4fd6-a328-2ef3b504c9c3', '68a3f405-e599-4339-b2a8-058311132e20'}, 'updated': set(), 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:01:30.269146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:419 - agent port security group processed in 0.000 Sep 25 01:01:30.277228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up [] and devices down [] completed. Sep 25 01:01:30.277915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for {'c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2', 'c41e83db-31a6-4fd6-a328-2ef3b504c9c3', '68a3f405-e599-4339-b2a8-058311132e20'} Sep 25 01:01:30.278476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:01:30.279208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 8 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:01:30.370729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b82881f-c680-4999-9564-87ff64e83a5f]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:01:30.372106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Ports {'c9cc5d17-940b-4469-8fdf-8ff8e5fac2a2', 'c41e83db-31a6-4fd6-a328-2ef3b504c9c3', '68a3f405-e599-4339-b2a8-058311132e20'} removed Sep 25 01:01:30.425058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["b57fb6cd-b0e7-4310-b1e9-58252d0b3e12","delete","tap078c0e3b-64",24,["map",[["attached-mac","fa:16:3e:51:25:e5"],["iface-id","078c0e3b-64fa-4b32-9903-3d2ac504d9d4"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:01:30.569450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port removal failed for set() {{(pid=107261) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 25 01:01:30.570670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:01:30.571334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Reclaiming vlan = 7 from net-id = e04e78f2-fc42-4b3e-9ba5-62cef58448f8, seg-id = 54 Sep 25 01:01:30.575977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xa5d7ab4e,OFPFlowMod(buffer_id=4294967295,command=3,cookie=13979250796582379444,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4103}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:30.580044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x7834e04d,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4150}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:30.580543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:419 - treat_devices_removed completed in 0.303 Sep 25 01:01:30.581005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:419 - ports processed. Elapsed:0.495 Sep 25 01:01:30.582905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:419 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.497 Sep 25 01:01:30.898576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-db4ae95a-7615-4ebd-a429-f535ee4fb261 None None] Resource Port deleted: 078c0e3b-64fa-4b32-9903-3d2ac504d9d4 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:30.907448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-db4ae95a-7615-4ebd-a429-f535ee4fb261 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (078c0e3b-64fa-4b32-9903-3d2ac504d9d4), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:30.929628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-65c8306c-4d67-4e61-afe0-7b6ad36ea91b admin admin] Resource Network deleted: e04e78f2-fc42-4b3e-9ba5-62cef58448f8 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:30.930270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-65c8306c-4d67-4e61-afe0-7b6ad36ea91b admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (e04e78f2-fc42-4b3e-9ba5-62cef58448f8), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:31.417480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a35d4452-d5c3-478d-8746-4afdb575e368 admin admin] Resource Port deleted: 078c0e3b-64fa-4b32-9903-3d2ac504d9d4 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:31.418730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a35d4452-d5c3-478d-8746-4afdb575e368 admin admin] Skipped duplicate delete event for 078c0e3b-64fa-4b32-9903-3d2ac504d9d4 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 25 01:01:31.470948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ee418c8a-e674-4630-9f35-c341f3ab6b9c admin admin] Resource SecurityGroup deleted: 228a413f-3378-42d6-84fd-cf375d775113 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:31.471839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ee418c8a-e674-4630-9f35-c341f3ab6b9c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (228a413f-3378-42d6-84fd-cf375d775113), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:31.473153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee418c8a-e674-4630-9f35-c341f3ab6b9c admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('228a413f-3378-42d6-84fd-cf375d775113',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:01:31.508111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ee418c8a-e674-4630-9f35-c341f3ab6b9c admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('228a413f-3378-42d6-84fd-cf375d775113',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:01:31.509719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ee418c8a-e674-4630-9f35-c341f3ab6b9c admin admin] Resource SecurityGroupRule deleted: 3342341f-6be0-416e-b642-9a6bf4adc461 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:31.510272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ee418c8a-e674-4630-9f35-c341f3ab6b9c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (3342341f-6be0-416e-b642-9a6bf4adc461), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:31.511641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ee418c8a-e674-4630-9f35-c341f3ab6b9c admin admin] Security group rule updated ['228a413f-3378-42d6-84fd-cf375d775113'] Sep 25 01:01:31.512342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ee418c8a-e674-4630-9f35-c341f3ab6b9c admin admin] Resource SecurityGroupRule deleted: b3d9cd87-47e6-4689-8fd4-b907f4d2fbac {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:31.512963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ee418c8a-e674-4630-9f35-c341f3ab6b9c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (b3d9cd87-47e6-4689-8fd4-b907f4d2fbac), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:31.513795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ee418c8a-e674-4630-9f35-c341f3ab6b9c admin admin] Security group rule updated ['228a413f-3378-42d6-84fd-cf375d775113'] Sep 25 01:01:31.514490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ee418c8a-e674-4630-9f35-c341f3ab6b9c admin admin] Resource SecurityGroupRule deleted: b977ef05-178f-4f0d-bd01-aac2b8900b6c {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:31.515091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ee418c8a-e674-4630-9f35-c341f3ab6b9c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (b977ef05-178f-4f0d-bd01-aac2b8900b6c), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:31.515651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ee418c8a-e674-4630-9f35-c341f3ab6b9c admin admin] Security group rule updated ['228a413f-3378-42d6-84fd-cf375d775113'] Sep 25 01:01:31.516485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ee418c8a-e674-4630-9f35-c341f3ab6b9c admin admin] Resource SecurityGroupRule deleted: c887f708-a92b-43c0-947b-3b8c97a13436 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:31.516899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ee418c8a-e674-4630-9f35-c341f3ab6b9c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (c887f708-a92b-43c0-947b-3b8c97a13436), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:31.517760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ee418c8a-e674-4630-9f35-c341f3ab6b9c admin admin] Security group rule updated ['228a413f-3378-42d6-84fd-cf375d775113'] Sep 25 01:01:32.087990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:420 started Sep 25 01:01:32.095451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e04f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=819000000,duration_sec=854,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:32.097117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:01:32.098913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:420 - starting polling. Elapsed:0.010 Sep 25 01:01:32.110812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:32.147052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e051,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 24}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:32.150966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:420 - port information retrieved. Elapsed:0.060 Sep 25 01:01:32.152024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', '223185f3-b5c4-4c49-9934-15eec28454bf', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', 'ce1017e5-9b95-4c64-a292-cd0bafd98099', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', '312a0875-9d08-4c94-b6f3-3135500afa6a', 'd4dca6ad-037a-430a-80c1-dd62be445e07', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '4a688d1f-1335-463f-b319-bcba153c442f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'de4727a2-569d-44c6-a53e-ecc89817f610'}, 'added': set(), 'removed': {'078c0e3b-64fa-4b32-9903-3d2ac504d9d4'}, 'updated': set(), 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:01:32.154038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:420 - agent port security group processed in 0.000 Sep 25 01:01:32.174595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up [] and devices down [] completed. Sep 25 01:01:32.175635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for {'078c0e3b-64fa-4b32-9903-3d2ac504d9d4'} Sep 25 01:01:32.177566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 4 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:01:32.241851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a35d4452-d5c3-478d-8746-4afdb575e368 admin admin] Resource Network deleted: f9e440d6-f48e-45bb-9a01-3ccd9ccf9488 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:32.242895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a35d4452-d5c3-478d-8746-4afdb575e368 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (f9e440d6-f48e-45bb-9a01-3ccd9ccf9488), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:32.315439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31f0394-8377-4e1b-98c8-26ae5958dea5]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:01:32.316311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Ports {'078c0e3b-64fa-4b32-9903-3d2ac504d9d4'} removed Sep 25 01:01:32.424122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port removal failed for set() {{(pid=107261) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 25 01:01:32.425251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Reclaiming vlan = 10 from net-id = f9e440d6-f48e-45bb-9a01-3ccd9ccf9488, seg-id = 66 Sep 25 01:01:32.470465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xa5d7ab50,OFPFlowMod(buffer_id=4294967295,command=3,cookie=13979250796582379444,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4106}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:32.489689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x7834e053,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4162}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:32.489981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:420 - treat_devices_removed completed in 0.314 Sep 25 01:01:32.495647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:420 - ports processed. Elapsed:0.403 Sep 25 01:01:32.496274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:420 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.408 Sep 25 01:01:33.190855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-464a2de5-4bc7-44dd-8362-b99766e54d5c tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:01:31Z,data_plane_status=None,description='',device_id='fdb14c73-6de8-4097-83d7-44f81a01abab',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=b7527175-254d-4003-8922-2e8834ba4a91,mac_address=fa:16:3e:58:3f:52,name='',network_id=31fa7821-6345-4f48-b070-9ceab6d12adf,numa_affinity_policy=,project_id='46f19fd9ad1e4880961d1eee75883687',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(b7527175-254d-4003-8922-2e8834ba4a91),security_group_ids=set([0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c]),status='DOWN',updated_at=2022-09-25T01:01:32Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:33.191961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-464a2de5-4bc7-44dd-8362-b99766e54d5c tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (b7527175-254d-4003-8922-2e8834ba4a91), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:33.192359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-464a2de5-4bc7-44dd-8362-b99766e54d5c tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Security group member updated {'0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c'} Sep 25 01:01:33.907676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e572f870-623d-4480-a94b-d69c94be2587 admin admin] Resource Port deleted: 223185f3-b5c4-4c49-9934-15eec28454bf {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:33.917994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e572f870-623d-4480-a94b-d69c94be2587 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (223185f3-b5c4-4c49-9934-15eec28454bf), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:34.037670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-903a9ae9-1442-4ede-8c04-c5a970dcc403 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:01:33Z,description='Default security group',id=329334f8-e8bb-4e5a-8d63-b84cea214a77,is_default=True,name='default',project_id='a0010b18914c438d9828a77f9fa2237e',revision_number=1,rules=[SecurityGroupRule(079dcea8-ad75-4ef8-a793-8ceda7978268),SecurityGroupRule(2c475eb9-407b-49e8-af22-9eee1c945307),SecurityGroupRule(54275d0e-2522-44cb-8b7a-12958e86ca2d),SecurityGroupRule(a6ca957f-e055-453d-86b1-89faf5345e24)],shared=False,stateful=True,updated_at=2022-09-25T01:01:33Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:34.039030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-903a9ae9-1442-4ede-8c04-c5a970dcc403 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (329334f8-e8bb-4e5a-8d63-b84cea214a77), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:34.042959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-903a9ae9-1442-4ede-8c04-c5a970dcc403 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:01:33Z,description=,direction='egress',ethertype='IPv6',id=079dcea8-ad75-4ef8-a793-8ceda7978268,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a0010b18914c438d9828a77f9fa2237e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=329334f8-e8bb-4e5a-8d63-b84cea214a77,updated_at=2022-09-25T01:01:33Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:34.045978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-903a9ae9-1442-4ede-8c04-c5a970dcc403 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (079dcea8-ad75-4ef8-a793-8ceda7978268), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:34.046950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-903a9ae9-1442-4ede-8c04-c5a970dcc403 admin admin] Security group rule updated ['329334f8-e8bb-4e5a-8d63-b84cea214a77'] Sep 25 01:01:34.052102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-903a9ae9-1442-4ede-8c04-c5a970dcc403 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:01:33Z,description=,direction='ingress',ethertype='IPv6',id=2c475eb9-407b-49e8-af22-9eee1c945307,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a0010b18914c438d9828a77f9fa2237e',protocol=,remote_address_group_id=,remote_group_id=329334f8-e8bb-4e5a-8d63-b84cea214a77,remote_ip_prefix=,revision_number=0,security_group_id=329334f8-e8bb-4e5a-8d63-b84cea214a77,updated_at=2022-09-25T01:01:33Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:34.056957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-903a9ae9-1442-4ede-8c04-c5a970dcc403 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (2c475eb9-407b-49e8-af22-9eee1c945307), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:34.069808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-903a9ae9-1442-4ede-8c04-c5a970dcc403 admin admin] Security group rule updated ['329334f8-e8bb-4e5a-8d63-b84cea214a77'] Sep 25 01:01:34.071114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-903a9ae9-1442-4ede-8c04-c5a970dcc403 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:01:33Z,description=,direction='egress',ethertype='IPv4',id=54275d0e-2522-44cb-8b7a-12958e86ca2d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a0010b18914c438d9828a77f9fa2237e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=329334f8-e8bb-4e5a-8d63-b84cea214a77,updated_at=2022-09-25T01:01:33Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:34.071859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-903a9ae9-1442-4ede-8c04-c5a970dcc403 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (54275d0e-2522-44cb-8b7a-12958e86ca2d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:34.072399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-903a9ae9-1442-4ede-8c04-c5a970dcc403 admin admin] Security group rule updated ['329334f8-e8bb-4e5a-8d63-b84cea214a77'] Sep 25 01:01:34.073693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-903a9ae9-1442-4ede-8c04-c5a970dcc403 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:01:33Z,description=,direction='ingress',ethertype='IPv4',id=a6ca957f-e055-453d-86b1-89faf5345e24,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a0010b18914c438d9828a77f9fa2237e',protocol=,remote_address_group_id=,remote_group_id=329334f8-e8bb-4e5a-8d63-b84cea214a77,remote_ip_prefix=,revision_number=0,security_group_id=329334f8-e8bb-4e5a-8d63-b84cea214a77,updated_at=2022-09-25T01:01:33Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:34.074323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-903a9ae9-1442-4ede-8c04-c5a970dcc403 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (a6ca957f-e055-453d-86b1-89faf5345e24), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:34.074845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-903a9ae9-1442-4ede-8c04-c5a970dcc403 admin admin] Security group rule updated ['329334f8-e8bb-4e5a-8d63-b84cea214a77'] Sep 25 01:01:34.089474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:421 started Sep 25 01:01:34.092866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e055,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=818000000,duration_sec=856,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:34.093982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:01:34.095936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:421 - starting polling. Elapsed:0.005 Sep 25 01:01:34.100671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:34.106372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-223185f3-b5, col_values=(('tag', 4095),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:01:34.122117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e057,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 28}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:34.122906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['223185f3-b5c4-4c49-9934-15eec28454bf'] Sep 25 01:01:34.124056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 4 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:01:34.267710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[222bb5f4-353e-49e2-8ad5-08149b55c57c]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:01:34.283113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:421 - port information retrieved. Elapsed:0.194 Sep 25 01:01:34.285328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:421 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.196 Sep 25 01:01:34.524024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-903a9ae9-1442-4ede-8c04-c5a970dcc403 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-25T01:01:33Z,description='',dns_domain=None,id=f3ba241a-0a59-40ac-b944-58ea596aa894,mtu=1500,name='tempest-EncryptedVolumesExtendAttachedTest-920940464-network',project_id='a0010b18914c438d9828a77f9fa2237e',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(f3ba241a-0a59-40ac-b944-58ea596aa894),segments=[NetworkSegment(03616da7-ba01-461c-b0f8-8ad66328819d)],shared=False,status='ACTIVE',updated_at=2022-09-25T01:01:34Z,vlan_transparent=) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:34.525323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-903a9ae9-1442-4ede-8c04-c5a970dcc403 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (f3ba241a-0a59-40ac-b944-58ea596aa894), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:34.901557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager [None req-903a9ae9-1442-4ede-8c04-c5a970dcc403 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network f3ba241a-0a59-40ac-b944-58ea596aa894 with segmentation id not found. Sep 25 01:01:34.901557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 25 01:01:34.901557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 25 01:01:34.901557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 25 01:01:34.901557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 25 01:01:34.901557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 25 01:01:34.901557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 25 01:01:34.901557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 25 01:01:34.901557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 25 01:01:34.901557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 25 01:01:34.901557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 25 01:01:34.901557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 25 01:01:34.901557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 25 01:01:34.903768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 25 01:01:34.903768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 25 01:01:34.903768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 25 01:01:34.903768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network f3ba241a-0a59-40ac-b944-58ea596aa894 with segmentation id not found. Sep 25 01:01:34.903768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Sep 25 01:01:35.006191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1309fdfe-771b-4e35-bffa-68127e2a144e service neutron] Resource Port b7527175-254d-4003-8922-2e8834ba4a91 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=b7527175-254d-4003-8922-2e8834ba4a91,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=b7527175-254d-4003-8922-2e8834ba4a91,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:01:35.006803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1309fdfe-771b-4e35-bffa-68127e2a144e service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (b7527175-254d-4003-8922-2e8834ba4a91), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:35.687369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d9139013-91f4-4c32-95f9-9b8cef3e5f4e admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(3afd7f7d-1105-4c58-918c-d1c9426277c0)],cidr=172.20.0.0/28,created_at=2022-09-25T01:01:35Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=c7007c43-5105-4764-bb2c-185e4cabcba1,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-EncryptedVolumesExtendAttachedTest-920940464-subnet',network_id=f3ba241a-0a59-40ac-b944-58ea596aa894,project_id='a0010b18914c438d9828a77f9fa2237e',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-25T01:01:35Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:35.690281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d9139013-91f4-4c32-95f9-9b8cef3e5f4e admin admin] Publish callbacks [] for Subnet (c7007c43-5105-4764-bb2c-185e4cabcba1), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:36.030697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1309fdfe-771b-4e35-bffa-68127e2a144e service neutron] Resource Port b7527175-254d-4003-8922-2e8834ba4a91 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=b7527175-254d-4003-8922-2e8834ba4a91,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=b7527175-254d-4003-8922-2e8834ba4a91,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=b7527175-254d-4003-8922-2e8834ba4a91,segment=NetworkSegment(5580d2ab-1c02-4162-bded-4b179649cc54),segment_id=5580d2ab-1c02-4162-bded-4b179649cc54)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:01:36.033975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1309fdfe-771b-4e35-bffa-68127e2a144e service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (b7527175-254d-4003-8922-2e8834ba4a91), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:36.091759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:422 started Sep 25 01:01:36.097792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e059,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=821000000,duration_sec=858,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:36.099147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:01:36.100248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:422 - starting polling. Elapsed:0.009 Sep 25 01:01:36.115063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:36.131549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:422 - port information retrieved. Elapsed:0.040 Sep 25 01:01:36.132149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:422 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.041 Sep 25 01:01:36.723243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["bd65d08a-7f32-4fbe-ae9e-26c2e0c43058","delete","qr-223185f3-b5",28,["map",[["attached-mac","fa:16:3e:50:42:1d"],["iface-id","223185f3-b5c4-4c49-9934-15eec28454bf"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:01:36.926633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-079bc3c6-bdb9-472b-8e89-77c0fd9e15c3 admin admin] Resource Port deleted: d4dca6ad-037a-430a-80c1-dd62be445e07 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:36.927781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-079bc3c6-bdb9-472b-8e89-77c0fd9e15c3 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (d4dca6ad-037a-430a-80c1-dd62be445e07), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:37.004265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9e367efd-5d7d-412e-8b00-27a36ba5eb32 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:01:35Z,data_plane_status=None,description='',device_id='cb07cc70-0299-47dc-97cb-e3b82c1a47b2',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=e90855c6-13bf-47db-8fb7-7226a222a0c7,mac_address=fa:16:3e:90:b6:43,name='',network_id=5dc49b54-686c-4619-ad4c-65c72c26fd31,numa_affinity_policy=,project_id='f08425c00f0c49ddbe42b21ddbc7ff3f',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(e90855c6-13bf-47db-8fb7-7226a222a0c7),security_group_ids=set([02453046-f588-47d0-980a-e2cdbf9b7e63]),status='DOWN',updated_at=2022-09-25T01:01:36Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:37.004849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9e367efd-5d7d-412e-8b00-27a36ba5eb32 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (e90855c6-13bf-47db-8fb7-7226a222a0c7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:37.005467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9e367efd-5d7d-412e-8b00-27a36ba5eb32 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group member updated {'02453046-f588-47d0-980a-e2cdbf9b7e63'} Sep 25 01:01:37.252891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["17cccc67-4e88-4825-bbec-ff584d7d224e","delete","qg-d4dca6ad-03",29,["map",[["attached-mac","fa:16:3e:73:4a:1e"],["iface-id","d4dca6ad-037a-430a-80c1-dd62be445e07"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:01:37.782232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ca4abff5-7de9-48c4-a50c-92a517af403e admin admin] Resource Subnet deleted: 4f943db5-728a-408e-91ba-0a8afa5e45da {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:37.784180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ca4abff5-7de9-48c4-a50c-92a517af403e admin admin] Publish callbacks [] for Subnet (4f943db5-728a-408e-91ba-0a8afa5e45da), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:38.093879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:423 started Sep 25 01:01:38.100958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e05b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=823000000,duration_sec=860,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:38.101918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:01:38.103908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:423 - starting polling. Elapsed:0.010 Sep 25 01:01:38.112458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:38.135861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e05d,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 28}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:38.145788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e05f,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 29}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:38.146454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:423 - port information retrieved. Elapsed:0.054 Sep 25 01:01:38.147011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', 'ce1017e5-9b95-4c64-a292-cd0bafd98099', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', '312a0875-9d08-4c94-b6f3-3135500afa6a', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '4a688d1f-1335-463f-b319-bcba153c442f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'de4727a2-569d-44c6-a53e-ecc89817f610'}, 'added': set(), 'removed': {'223185f3-b5c4-4c49-9934-15eec28454bf', 'd4dca6ad-037a-430a-80c1-dd62be445e07'}, 'updated': set(), 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:01:38.147514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:423 - agent port security group processed in 0.000 Sep 25 01:01:38.153139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up [] and devices down [] completed. Sep 25 01:01:38.154188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for {'223185f3-b5c4-4c49-9934-15eec28454bf', 'd4dca6ad-037a-430a-80c1-dd62be445e07'} Sep 25 01:01:38.154715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 223185f3-b5c4-4c49-9934-15eec28454bf is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:01:38.155348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 4 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:01:38.159818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["29cf924b-2794-431e-a2f4-afa460b6231a","delete","tapce1017e5-9b",27,["map",[["attached-mac","fa:16:3e:25:3c:fc"],["iface-id","ce1017e5-9b95-4c64-a292-cd0bafd98099"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:01:38.208160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-84fb13d5-16f5-45ad-9c49-95060678bd4c admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:01:37Z,description='Default security group',id=930f0e21-f6df-496a-8a60-788e9878854b,is_default=True,name='default',project_id='72ebfef0864443e598916e212e9811df',revision_number=1,rules=[SecurityGroupRule(495b1584-b6d0-456c-a787-556d5fe41607),SecurityGroupRule(7a1cbb4a-51b3-4bf9-8bab-da7be35fc195),SecurityGroupRule(8c64c6fd-7e9d-4866-8a18-67fdd58f7d67),SecurityGroupRule(c50809be-4026-407f-bf26-2f2cde05390d)],shared=False,stateful=True,updated_at=2022-09-25T01:01:37Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:38.209427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-84fb13d5-16f5-45ad-9c49-95060678bd4c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (930f0e21-f6df-496a-8a60-788e9878854b), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:38.212690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-84fb13d5-16f5-45ad-9c49-95060678bd4c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:01:37Z,description=,direction='ingress',ethertype='IPv4',id=495b1584-b6d0-456c-a787-556d5fe41607,normalized_cidr=None,port_range_max=,port_range_min=,project_id='72ebfef0864443e598916e212e9811df',protocol=,remote_address_group_id=,remote_group_id=930f0e21-f6df-496a-8a60-788e9878854b,remote_ip_prefix=,revision_number=0,security_group_id=930f0e21-f6df-496a-8a60-788e9878854b,updated_at=2022-09-25T01:01:37Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:38.213638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-84fb13d5-16f5-45ad-9c49-95060678bd4c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (495b1584-b6d0-456c-a787-556d5fe41607), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:38.214975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-84fb13d5-16f5-45ad-9c49-95060678bd4c admin admin] Security group rule updated ['930f0e21-f6df-496a-8a60-788e9878854b'] Sep 25 01:01:38.216393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-84fb13d5-16f5-45ad-9c49-95060678bd4c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:01:37Z,description=,direction='egress',ethertype='IPv4',id=7a1cbb4a-51b3-4bf9-8bab-da7be35fc195,normalized_cidr=None,port_range_max=,port_range_min=,project_id='72ebfef0864443e598916e212e9811df',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=930f0e21-f6df-496a-8a60-788e9878854b,updated_at=2022-09-25T01:01:37Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:38.217042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-84fb13d5-16f5-45ad-9c49-95060678bd4c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (7a1cbb4a-51b3-4bf9-8bab-da7be35fc195), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:38.218228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-84fb13d5-16f5-45ad-9c49-95060678bd4c admin admin] Security group rule updated ['930f0e21-f6df-496a-8a60-788e9878854b'] Sep 25 01:01:38.219416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-84fb13d5-16f5-45ad-9c49-95060678bd4c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:01:37Z,description=,direction='ingress',ethertype='IPv6',id=8c64c6fd-7e9d-4866-8a18-67fdd58f7d67,normalized_cidr=None,port_range_max=,port_range_min=,project_id='72ebfef0864443e598916e212e9811df',protocol=,remote_address_group_id=,remote_group_id=930f0e21-f6df-496a-8a60-788e9878854b,remote_ip_prefix=,revision_number=0,security_group_id=930f0e21-f6df-496a-8a60-788e9878854b,updated_at=2022-09-25T01:01:37Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:38.220140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-84fb13d5-16f5-45ad-9c49-95060678bd4c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (8c64c6fd-7e9d-4866-8a18-67fdd58f7d67), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:38.220889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-84fb13d5-16f5-45ad-9c49-95060678bd4c admin admin] Security group rule updated ['930f0e21-f6df-496a-8a60-788e9878854b'] Sep 25 01:01:38.221972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-84fb13d5-16f5-45ad-9c49-95060678bd4c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:01:37Z,description=,direction='egress',ethertype='IPv6',id=c50809be-4026-407f-bf26-2f2cde05390d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='72ebfef0864443e598916e212e9811df',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=930f0e21-f6df-496a-8a60-788e9878854b,updated_at=2022-09-25T01:01:37Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:38.223363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-84fb13d5-16f5-45ad-9c49-95060678bd4c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (c50809be-4026-407f-bf26-2f2cde05390d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:38.223910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-84fb13d5-16f5-45ad-9c49-95060678bd4c admin admin] Security group rule updated ['930f0e21-f6df-496a-8a60-788e9878854b'] Sep 25 01:01:38.278077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3335c7f-d0ad-4c11-995a-23e0464126c2]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:01:38.279329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Ports {'223185f3-b5c4-4c49-9934-15eec28454bf', 'd4dca6ad-037a-430a-80c1-dd62be445e07'} removed Sep 25 01:01:38.390251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1d432aa0-51f0-4d0f-9edd-43232ee9eee0 admin admin] Resource Port deleted: ce1017e5-9b95-4c64-a292-cd0bafd98099 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:38.390812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1d432aa0-51f0-4d0f-9edd-43232ee9eee0 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (ce1017e5-9b95-4c64-a292-cd0bafd98099), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:38.467566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port removal failed for set() {{(pid=107261) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 25 01:01:38.469637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:01:38.470728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:423 - treat_devices_removed completed in 0.316 Sep 25 01:01:38.472699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:423 - ports processed. Elapsed:0.380 Sep 25 01:01:38.473831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:423 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.381 Sep 25 01:01:38.612174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0d44c134-0744-4cbe-bce7-a84429531fb2 None None] Resource Port deleted: ce1017e5-9b95-4c64-a292-cd0bafd98099 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:38.613239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0d44c134-0744-4cbe-bce7-a84429531fb2 None None] Skipped duplicate delete event for ce1017e5-9b95-4c64-a292-cd0bafd98099 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 25 01:01:38.719866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1d432aa0-51f0-4d0f-9edd-43232ee9eee0 admin admin] Resource Network deleted: 305a606b-4752-46cc-b1fb-85da780b88ce {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:38.720351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1d432aa0-51f0-4d0f-9edd-43232ee9eee0 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (305a606b-4752-46cc-b1fb-85da780b88ce), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:38.852310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3b1507bd-5e24-4ff2-a014-ed2ac6bca9e4 service neutron] Resource Port e90855c6-13bf-47db-8fb7-7226a222a0c7 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=e90855c6-13bf-47db-8fb7-7226a222a0c7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=e90855c6-13bf-47db-8fb7-7226a222a0c7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:01:38.853998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3b1507bd-5e24-4ff2-a014-ed2ac6bca9e4 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (e90855c6-13bf-47db-8fb7-7226a222a0c7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:39.030832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-84fb13d5-16f5-45ad-9c49-95060678bd4c admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-25T01:01:38Z,description='',dns_domain=None,id=bb3d0de9-3acc-4b6d-9c56-3bd7e7e28ff2,mtu=1500,name='tempest-EncryptedVolumesExtendAttachedTest-758232165-network',project_id='72ebfef0864443e598916e212e9811df',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(bb3d0de9-3acc-4b6d-9c56-3bd7e7e28ff2),segments=[NetworkSegment(90ad231d-b55c-484e-a4ba-ac9370c1e65c)],shared=False,status='ACTIVE',updated_at=2022-09-25T01:01:38Z,vlan_transparent=) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:39.031462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-84fb13d5-16f5-45ad-9c49-95060678bd4c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (bb3d0de9-3acc-4b6d-9c56-3bd7e7e28ff2), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:39.201577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager [None req-84fb13d5-16f5-45ad-9c49-95060678bd4c admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network bb3d0de9-3acc-4b6d-9c56-3bd7e7e28ff2 with segmentation id not found. Sep 25 01:01:39.201577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 25 01:01:39.201577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 25 01:01:39.201577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 25 01:01:39.201577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 25 01:01:39.201577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 25 01:01:39.201577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 25 01:01:39.201577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 25 01:01:39.201577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 25 01:01:39.201577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 25 01:01:39.201577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 25 01:01:39.201577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 25 01:01:39.201577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 25 01:01:39.202751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 25 01:01:39.202751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 25 01:01:39.202751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 25 01:01:39.202751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network bb3d0de9-3acc-4b6d-9c56-3bd7e7e28ff2 with segmentation id not found. Sep 25 01:01:39.202751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Sep 25 01:01:39.663491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-18a2bf04-0b35-4db6-b19e-ca4f1810b04a admin admin] Resource SecurityGroup deleted: 5820ec3a-8d2a-47c6-8b82-59a1dad211f3 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:39.664041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-18a2bf04-0b35-4db6-b19e-ca4f1810b04a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (5820ec3a-8d2a-47c6-8b82-59a1dad211f3), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:39.664645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a2bf04-0b35-4db6-b19e-ca4f1810b04a admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('5820ec3a-8d2a-47c6-8b82-59a1dad211f3',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:01:39.684557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-20022cfa-4268-422a-8ceb-50f0d3e1c587 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(095dfaff-4406-402f-8b8b-f74303f3d036)],cidr=172.20.0.0/28,created_at=2022-09-25T01:01:39Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=81c33155-19de-4f26-b1d6-77def531e62f,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-EncryptedVolumesExtendAttachedTest-758232165-subnet',network_id=bb3d0de9-3acc-4b6d-9c56-3bd7e7e28ff2,project_id='72ebfef0864443e598916e212e9811df',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-25T01:01:39Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:39.685436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-20022cfa-4268-422a-8ceb-50f0d3e1c587 admin admin] Publish callbacks [] for Subnet (81c33155-19de-4f26-b1d6-77def531e62f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:39.714725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-18a2bf04-0b35-4db6-b19e-ca4f1810b04a admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('5820ec3a-8d2a-47c6-8b82-59a1dad211f3',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:01:39.715812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-18a2bf04-0b35-4db6-b19e-ca4f1810b04a admin admin] Resource SecurityGroupRule deleted: 059112b5-450d-43f3-848e-b7b4da7d4cea {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:39.717237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-18a2bf04-0b35-4db6-b19e-ca4f1810b04a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (059112b5-450d-43f3-848e-b7b4da7d4cea), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:39.718131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-18a2bf04-0b35-4db6-b19e-ca4f1810b04a admin admin] Security group rule updated ['5820ec3a-8d2a-47c6-8b82-59a1dad211f3'] Sep 25 01:01:39.718836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-18a2bf04-0b35-4db6-b19e-ca4f1810b04a admin admin] Resource SecurityGroupRule deleted: 3b858c90-b191-428f-a0a4-edc3a086c93f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:39.719442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-18a2bf04-0b35-4db6-b19e-ca4f1810b04a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (3b858c90-b191-428f-a0a4-edc3a086c93f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:39.720003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-18a2bf04-0b35-4db6-b19e-ca4f1810b04a admin admin] Security group rule updated ['5820ec3a-8d2a-47c6-8b82-59a1dad211f3'] Sep 25 01:01:39.721898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-18a2bf04-0b35-4db6-b19e-ca4f1810b04a admin admin] Resource SecurityGroupRule deleted: 55fe58a3-7f50-4faa-b963-1734306ed895 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:39.722679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-18a2bf04-0b35-4db6-b19e-ca4f1810b04a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (55fe58a3-7f50-4faa-b963-1734306ed895), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:39.723729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-18a2bf04-0b35-4db6-b19e-ca4f1810b04a admin admin] Security group rule updated ['5820ec3a-8d2a-47c6-8b82-59a1dad211f3'] Sep 25 01:01:39.724732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-18a2bf04-0b35-4db6-b19e-ca4f1810b04a admin admin] Resource SecurityGroupRule deleted: 5ef38116-5cc8-4f99-8063-b5b21bbfb3f1 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:39.725494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-18a2bf04-0b35-4db6-b19e-ca4f1810b04a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (5ef38116-5cc8-4f99-8063-b5b21bbfb3f1), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:39.726035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-18a2bf04-0b35-4db6-b19e-ca4f1810b04a admin admin] Security group rule updated ['5820ec3a-8d2a-47c6-8b82-59a1dad211f3'] Sep 25 01:01:40.027357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3b1507bd-5e24-4ff2-a014-ed2ac6bca9e4 service neutron] Resource Port e90855c6-13bf-47db-8fb7-7226a222a0c7 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=e90855c6-13bf-47db-8fb7-7226a222a0c7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=e90855c6-13bf-47db-8fb7-7226a222a0c7,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=e90855c6-13bf-47db-8fb7-7226a222a0c7,segment=NetworkSegment(32553459-8243-41b9-9fc0-bae9f5646e9f),segment_id=32553459-8243-41b9-9fc0-bae9f5646e9f)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:01:40.028413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3b1507bd-5e24-4ff2-a014-ed2ac6bca9e4 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (e90855c6-13bf-47db-8fb7-7226a222a0c7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:40.094551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:424 started Sep 25 01:01:40.099274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e061,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=824000000,duration_sec=862,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:40.100621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:01:40.101549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:424 - starting polling. Elapsed:0.007 Sep 25 01:01:40.104757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:40.116713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e063,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 27}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:40.117037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:424 - port information retrieved. Elapsed:0.023 Sep 25 01:01:40.117418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', '312a0875-9d08-4c94-b6f3-3135500afa6a', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '4a688d1f-1335-463f-b319-bcba153c442f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'de4727a2-569d-44c6-a53e-ecc89817f610'}, 'added': set(), 'removed': {'ce1017e5-9b95-4c64-a292-cd0bafd98099'}, 'updated': set(), 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:01:40.118489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:424 - agent port security group processed in 0.000 Sep 25 01:01:40.128155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up [] and devices down [] completed. Sep 25 01:01:40.128469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for {'ce1017e5-9b95-4c64-a292-cd0bafd98099'} Sep 25 01:01:40.129539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 4 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:01:40.205615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4ab2e6-90fa-4029-b23d-7b99b8e6c2ee]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:01:40.206623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Ports {'ce1017e5-9b95-4c64-a292-cd0bafd98099'} removed Sep 25 01:01:40.283046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port removal failed for set() {{(pid=107261) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 25 01:01:40.283885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Reclaiming vlan = 11 from net-id = 305a606b-4752-46cc-b1fb-85da780b88ce, seg-id = 78 Sep 25 01:01:40.288234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xa5d7ab52,OFPFlowMod(buffer_id=4294967295,command=3,cookie=13979250796582379444,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4107}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:40.294887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x7834e065,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4174}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:40.295576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:424 - treat_devices_removed completed in 0.167 Sep 25 01:01:40.297007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:424 - ports processed. Elapsed:0.203 Sep 25 01:01:40.297564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:424 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.203 Sep 25 01:01:40.424912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fe0ef1b7-6d6a-4869-abcf-e20e8f21cb97 admin admin] Resource Subnet deleted: c7007c43-5105-4764-bb2c-185e4cabcba1 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:40.425311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fe0ef1b7-6d6a-4869-abcf-e20e8f21cb97 admin admin] Publish callbacks [] for Subnet (c7007c43-5105-4764-bb2c-185e4cabcba1), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:40.620900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 4aef1009-d2d3-4c6f-af8a-c5134e19fa37 updated (revision_number 5->6). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'BUILD'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:01:40.621674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (4aef1009-d2d3-4c6f-af8a-c5134e19fa37), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:40.782074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9f007355-bd55-4c4a-9c63-9f72d518c91c admin admin] Resource SecurityGroup deleted: d56f1d30-4c79-465a-93d9-903b9f37fd08 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:40.784028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9f007355-bd55-4c4a-9c63-9f72d518c91c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (d56f1d30-4c79-465a-93d9-903b9f37fd08), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:40.784595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f007355-bd55-4c4a-9c63-9f72d518c91c admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('d56f1d30-4c79-465a-93d9-903b9f37fd08',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:01:40.806554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9f007355-bd55-4c4a-9c63-9f72d518c91c admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('d56f1d30-4c79-465a-93d9-903b9f37fd08',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:01:40.809661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9f007355-bd55-4c4a-9c63-9f72d518c91c admin admin] Resource SecurityGroupRule deleted: 703f2e6e-2c9c-446b-aa91-3f3f0f161ee6 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:40.810525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9f007355-bd55-4c4a-9c63-9f72d518c91c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (703f2e6e-2c9c-446b-aa91-3f3f0f161ee6), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:40.812169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9f007355-bd55-4c4a-9c63-9f72d518c91c admin admin] Security group rule updated ['d56f1d30-4c79-465a-93d9-903b9f37fd08'] Sep 25 01:01:40.815669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9f007355-bd55-4c4a-9c63-9f72d518c91c admin admin] Resource SecurityGroupRule deleted: 705b8f34-a98b-48a1-af93-8f465637ed4c {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:40.816480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9f007355-bd55-4c4a-9c63-9f72d518c91c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (705b8f34-a98b-48a1-af93-8f465637ed4c), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:40.818245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9f007355-bd55-4c4a-9c63-9f72d518c91c admin admin] Security group rule updated ['d56f1d30-4c79-465a-93d9-903b9f37fd08'] Sep 25 01:01:40.819172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9f007355-bd55-4c4a-9c63-9f72d518c91c admin admin] Resource SecurityGroupRule deleted: a7e1ef1c-29a6-4e52-b471-3ced707c7905 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:40.820610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9f007355-bd55-4c4a-9c63-9f72d518c91c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (a7e1ef1c-29a6-4e52-b471-3ced707c7905), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:40.821346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9f007355-bd55-4c4a-9c63-9f72d518c91c admin admin] Security group rule updated ['d56f1d30-4c79-465a-93d9-903b9f37fd08'] Sep 25 01:01:40.824115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9f007355-bd55-4c4a-9c63-9f72d518c91c admin admin] Resource SecurityGroupRule deleted: b3cf8404-5817-438f-9574-83674e2e4384 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:40.824511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9f007355-bd55-4c4a-9c63-9f72d518c91c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (b3cf8404-5817-438f-9574-83674e2e4384), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:40.825226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9f007355-bd55-4c4a-9c63-9f72d518c91c admin admin] Security group rule updated ['d56f1d30-4c79-465a-93d9-903b9f37fd08'] Sep 25 01:01:41.374541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1e12c646-ebcc-41b4-9b6c-bff3e29998a9 admin admin] Resource Network deleted: f3ba241a-0a59-40ac-b944-58ea596aa894 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:41.376993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1e12c646-ebcc-41b4-9b6c-bff3e29998a9 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (f3ba241a-0a59-40ac-b944-58ea596aa894), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:41.650495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-be306958-558b-4662-9bde-4f47adfbfafb admin admin] Resource Subnet deleted: 81c33155-19de-4f26-b1d6-77def531e62f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:41.651026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-be306958-558b-4662-9bde-4f47adfbfafb admin admin] Publish callbacks [] for Subnet (81c33155-19de-4f26-b1d6-77def531e62f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:42.096248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:425 started Sep 25 01:01:42.100231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e067,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=825000000,duration_sec=864,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:42.101104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:01:42.108730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:425 - starting polling. Elapsed:0.005 Sep 25 01:01:42.111519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:42.114702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:425 - port information retrieved. Elapsed:0.019 Sep 25 01:01:42.115042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:425 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.019 Sep 25 01:01:42.228232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c36aba2d-5cbc-43a3-9f21-523aaa33063b admin admin] Resource Network deleted: bb3d0de9-3acc-4b6d-9c56-3bd7e7e28ff2 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:42.228973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c36aba2d-5cbc-43a3-9f21-523aaa33063b admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (bb3d0de9-3acc-4b6d-9c56-3bd7e7e28ff2), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:42.482366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a29fdd02-efdd-4d72-b615-799244d6343b admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:01:42Z,description='Default security group',id=e05b15b2-3672-49c0-a490-1e2728c4b3e0,is_default=True,name='default',project_id='69a3d6ce251e480d866a86ed9f6f2eb9',revision_number=1,rules=[SecurityGroupRule(043508f3-851f-4bb7-b1ab-ef4963eca3b4),SecurityGroupRule(5a041836-bd29-455d-9e18-4587e5da41be),SecurityGroupRule(c4f8c7ba-716d-4b7c-ad6e-af682f79098f),SecurityGroupRule(fbb5ae32-1356-4f31-893a-44fb714edfb7)],shared=False,stateful=True,updated_at=2022-09-25T01:01:42Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:42.483478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a29fdd02-efdd-4d72-b615-799244d6343b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (e05b15b2-3672-49c0-a490-1e2728c4b3e0), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:42.485001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a29fdd02-efdd-4d72-b615-799244d6343b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:01:42Z,description=,direction='egress',ethertype='IPv4',id=043508f3-851f-4bb7-b1ab-ef4963eca3b4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='69a3d6ce251e480d866a86ed9f6f2eb9',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e05b15b2-3672-49c0-a490-1e2728c4b3e0,updated_at=2022-09-25T01:01:42Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:42.486127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a29fdd02-efdd-4d72-b615-799244d6343b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (043508f3-851f-4bb7-b1ab-ef4963eca3b4), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:42.489506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a29fdd02-efdd-4d72-b615-799244d6343b admin admin] Security group rule updated ['e05b15b2-3672-49c0-a490-1e2728c4b3e0'] Sep 25 01:01:42.494178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a29fdd02-efdd-4d72-b615-799244d6343b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:01:42Z,description=,direction='ingress',ethertype='IPv4',id=5a041836-bd29-455d-9e18-4587e5da41be,normalized_cidr=None,port_range_max=,port_range_min=,project_id='69a3d6ce251e480d866a86ed9f6f2eb9',protocol=,remote_address_group_id=,remote_group_id=e05b15b2-3672-49c0-a490-1e2728c4b3e0,remote_ip_prefix=,revision_number=0,security_group_id=e05b15b2-3672-49c0-a490-1e2728c4b3e0,updated_at=2022-09-25T01:01:42Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:42.495210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a29fdd02-efdd-4d72-b615-799244d6343b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (5a041836-bd29-455d-9e18-4587e5da41be), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:42.495783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a29fdd02-efdd-4d72-b615-799244d6343b admin admin] Security group rule updated ['e05b15b2-3672-49c0-a490-1e2728c4b3e0'] Sep 25 01:01:42.496693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a29fdd02-efdd-4d72-b615-799244d6343b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:01:42Z,description=,direction='egress',ethertype='IPv6',id=c4f8c7ba-716d-4b7c-ad6e-af682f79098f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='69a3d6ce251e480d866a86ed9f6f2eb9',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e05b15b2-3672-49c0-a490-1e2728c4b3e0,updated_at=2022-09-25T01:01:42Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:42.499104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a29fdd02-efdd-4d72-b615-799244d6343b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (c4f8c7ba-716d-4b7c-ad6e-af682f79098f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:42.499693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a29fdd02-efdd-4d72-b615-799244d6343b admin admin] Security group rule updated ['e05b15b2-3672-49c0-a490-1e2728c4b3e0'] Sep 25 01:01:42.505414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a29fdd02-efdd-4d72-b615-799244d6343b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:01:42Z,description=,direction='ingress',ethertype='IPv6',id=fbb5ae32-1356-4f31-893a-44fb714edfb7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='69a3d6ce251e480d866a86ed9f6f2eb9',protocol=,remote_address_group_id=,remote_group_id=e05b15b2-3672-49c0-a490-1e2728c4b3e0,remote_ip_prefix=,revision_number=0,security_group_id=e05b15b2-3672-49c0-a490-1e2728c4b3e0,updated_at=2022-09-25T01:01:42Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:42.506211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a29fdd02-efdd-4d72-b615-799244d6343b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (fbb5ae32-1356-4f31-893a-44fb714edfb7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:42.506772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a29fdd02-efdd-4d72-b615-799244d6343b admin admin] Security group rule updated ['e05b15b2-3672-49c0-a490-1e2728c4b3e0'] Sep 25 01:01:42.582479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 4aef1009-d2d3-4c6f-af8a-c5134e19fa37 updated (revision_number 6->7). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:01:42.582862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (4aef1009-d2d3-4c6f-af8a-c5134e19fa37), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:42.760733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a29fdd02-efdd-4d72-b615-799244d6343b admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-25T01:01:42Z,description='',dns_domain=None,id=c62c61a7-64ad-4bd4-8ce7-b21b978664a6,mtu=1500,name='tempest-TestShelveInstance-1941265010-network',project_id='69a3d6ce251e480d866a86ed9f6f2eb9',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(c62c61a7-64ad-4bd4-8ce7-b21b978664a6),segments=[NetworkSegment(94789acf-3520-42cb-8735-238d89a1ebc7)],shared=False,status='ACTIVE',updated_at=2022-09-25T01:01:42Z,vlan_transparent=) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:42.761128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a29fdd02-efdd-4d72-b615-799244d6343b admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (c62c61a7-64ad-4bd4-8ce7-b21b978664a6), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:42.884112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager [None req-a29fdd02-efdd-4d72-b615-799244d6343b admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network c62c61a7-64ad-4bd4-8ce7-b21b978664a6 with segmentation id not found. Sep 25 01:01:42.884112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 25 01:01:42.884112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 25 01:01:42.884112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 25 01:01:42.884112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 25 01:01:42.884112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 25 01:01:42.884112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 25 01:01:42.884112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 25 01:01:42.884112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 25 01:01:42.884112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 25 01:01:42.884112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 25 01:01:42.884112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 25 01:01:42.884112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 25 01:01:42.886033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 25 01:01:42.886033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 25 01:01:42.886033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 25 01:01:42.886033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network c62c61a7-64ad-4bd4-8ce7-b21b978664a6 with segmentation id not found. Sep 25 01:01:42.886033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Sep 25 01:01:43.246758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-90590604-d442-48c9-8265-aa5bfc988fa5 admin admin] Resource SecurityGroup deleted: 329334f8-e8bb-4e5a-8d63-b84cea214a77 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:43.247778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-90590604-d442-48c9-8265-aa5bfc988fa5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (329334f8-e8bb-4e5a-8d63-b84cea214a77), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:43.251152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90590604-d442-48c9-8265-aa5bfc988fa5 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('329334f8-e8bb-4e5a-8d63-b84cea214a77',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:01:43.280851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-90590604-d442-48c9-8265-aa5bfc988fa5 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('329334f8-e8bb-4e5a-8d63-b84cea214a77',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:01:43.281407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-90590604-d442-48c9-8265-aa5bfc988fa5 admin admin] Resource SecurityGroupRule deleted: 079dcea8-ad75-4ef8-a793-8ceda7978268 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:43.282143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-90590604-d442-48c9-8265-aa5bfc988fa5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (079dcea8-ad75-4ef8-a793-8ceda7978268), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:43.282641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-90590604-d442-48c9-8265-aa5bfc988fa5 admin admin] Security group rule updated ['329334f8-e8bb-4e5a-8d63-b84cea214a77'] Sep 25 01:01:43.283533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-90590604-d442-48c9-8265-aa5bfc988fa5 admin admin] Resource SecurityGroupRule deleted: 2c475eb9-407b-49e8-af22-9eee1c945307 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:43.284071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-90590604-d442-48c9-8265-aa5bfc988fa5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (2c475eb9-407b-49e8-af22-9eee1c945307), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:43.284401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-90590604-d442-48c9-8265-aa5bfc988fa5 admin admin] Security group rule updated ['329334f8-e8bb-4e5a-8d63-b84cea214a77'] Sep 25 01:01:43.284866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-90590604-d442-48c9-8265-aa5bfc988fa5 admin admin] Resource SecurityGroupRule deleted: 54275d0e-2522-44cb-8b7a-12958e86ca2d {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:43.285372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-90590604-d442-48c9-8265-aa5bfc988fa5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (54275d0e-2522-44cb-8b7a-12958e86ca2d), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:43.285850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-90590604-d442-48c9-8265-aa5bfc988fa5 admin admin] Security group rule updated ['329334f8-e8bb-4e5a-8d63-b84cea214a77'] Sep 25 01:01:43.286591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-90590604-d442-48c9-8265-aa5bfc988fa5 admin admin] Resource SecurityGroupRule deleted: a6ca957f-e055-453d-86b1-89faf5345e24 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:43.287467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-90590604-d442-48c9-8265-aa5bfc988fa5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (a6ca957f-e055-453d-86b1-89faf5345e24), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:43.287969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-90590604-d442-48c9-8265-aa5bfc988fa5 admin admin] Security group rule updated ['329334f8-e8bb-4e5a-8d63-b84cea214a77'] Sep 25 01:01:43.439532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e5e928a0-13ef-4a18-8d30-e44d6c83e8b0 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(ca594a87-14bd-4d03-8c30-f4ab91ab5908)],cidr=172.20.0.0/28,created_at=2022-09-25T01:01:43Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=3a3c28a1-4968-4492-967d-c258b7838096,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestShelveInstance-1941265010-subnet',network_id=c62c61a7-64ad-4bd4-8ce7-b21b978664a6,project_id='69a3d6ce251e480d866a86ed9f6f2eb9',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-25T01:01:43Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:43.440043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e5e928a0-13ef-4a18-8d30-e44d6c83e8b0 admin admin] Publish callbacks [] for Subnet (3a3c28a1-4968-4492-967d-c258b7838096), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:44.097584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:426 started Sep 25 01:01:44.109522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e069,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=827000000,duration_sec=866,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:44.116037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:01:44.116949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:426 - starting polling. Elapsed:0.020 Sep 25 01:01:44.121087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:44.128326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:426 - port information retrieved. Elapsed:0.031 Sep 25 01:01:44.145315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:426 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.048 Sep 25 01:01:44.676369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fc5f7918-9872-4d84-b7a5-ab05d2a8e080 admin admin] Resource SecurityGroup deleted: 930f0e21-f6df-496a-8a60-788e9878854b {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:44.676929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fc5f7918-9872-4d84-b7a5-ab05d2a8e080 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (930f0e21-f6df-496a-8a60-788e9878854b), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:44.677532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc5f7918-9872-4d84-b7a5-ab05d2a8e080 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('930f0e21-f6df-496a-8a60-788e9878854b',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:01:44.855519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fc5f7918-9872-4d84-b7a5-ab05d2a8e080 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('930f0e21-f6df-496a-8a60-788e9878854b',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:01:44.856877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fc5f7918-9872-4d84-b7a5-ab05d2a8e080 admin admin] Resource SecurityGroupRule deleted: 495b1584-b6d0-456c-a787-556d5fe41607 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:44.857593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fc5f7918-9872-4d84-b7a5-ab05d2a8e080 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (495b1584-b6d0-456c-a787-556d5fe41607), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:44.858452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-fc5f7918-9872-4d84-b7a5-ab05d2a8e080 admin admin] Security group rule updated ['930f0e21-f6df-496a-8a60-788e9878854b'] Sep 25 01:01:44.859097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fc5f7918-9872-4d84-b7a5-ab05d2a8e080 admin admin] Resource SecurityGroupRule deleted: 7a1cbb4a-51b3-4bf9-8bab-da7be35fc195 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:44.859714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fc5f7918-9872-4d84-b7a5-ab05d2a8e080 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (7a1cbb4a-51b3-4bf9-8bab-da7be35fc195), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:44.860517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-fc5f7918-9872-4d84-b7a5-ab05d2a8e080 admin admin] Security group rule updated ['930f0e21-f6df-496a-8a60-788e9878854b'] Sep 25 01:01:44.861125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fc5f7918-9872-4d84-b7a5-ab05d2a8e080 admin admin] Resource SecurityGroupRule deleted: 8c64c6fd-7e9d-4866-8a18-67fdd58f7d67 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:44.861721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fc5f7918-9872-4d84-b7a5-ab05d2a8e080 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (8c64c6fd-7e9d-4866-8a18-67fdd58f7d67), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:44.862310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-fc5f7918-9872-4d84-b7a5-ab05d2a8e080 admin admin] Security group rule updated ['930f0e21-f6df-496a-8a60-788e9878854b'] Sep 25 01:01:44.862985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fc5f7918-9872-4d84-b7a5-ab05d2a8e080 admin admin] Resource SecurityGroupRule deleted: c50809be-4026-407f-bf26-2f2cde05390d {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:44.863698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fc5f7918-9872-4d84-b7a5-ab05d2a8e080 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (c50809be-4026-407f-bf26-2f2cde05390d), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:44.864236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-fc5f7918-9872-4d84-b7a5-ab05d2a8e080 admin admin] Security group rule updated ['930f0e21-f6df-496a-8a60-788e9878854b'] Sep 25 01:01:45.586145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-31a6bdd2-0f96-4719-b1ef-3faf7888c7c9 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:01:43Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-c62c61a7-64ad-4bd4-8ce7-b21b978664a6',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=d18a3c48-8be7-45c0-8641-dd3182b273bc,mac_address=fa:16:3e:61:db:45,name='',network_id=c62c61a7-64ad-4bd4-8ce7-b21b978664a6,numa_affinity_policy=,project_id='69a3d6ce251e480d866a86ed9f6f2eb9',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(d18a3c48-8be7-45c0-8641-dd3182b273bc),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T01:01:45Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:45.588872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-31a6bdd2-0f96-4719-b1ef-3faf7888c7c9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (d18a3c48-8be7-45c0-8641-dd3182b273bc), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:45.957150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port e90855c6-13bf-47db-8fb7-7226a222a0c7 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:01:45.957996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (e90855c6-13bf-47db-8fb7-7226a222a0c7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:46.100826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:427 started Sep 25 01:01:46.106570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e06b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=831000000,duration_sec=868,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:46.108231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:01:46.112182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:427 - starting polling. Elapsed:0.012 Sep 25 01:01:46.132432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:46.156113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:427 - port information retrieved. Elapsed:0.056 Sep 25 01:01:46.165297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:427 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.064 Sep 25 01:01:46.580444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-31a6bdd2-0f96-4719-b1ef-3faf7888c7c9 None None] Resource Port d18a3c48-8be7-45c0-8641-dd3182b273bc updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=d18a3c48-8be7-45c0-8641-dd3182b273bc,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=d18a3c48-8be7-45c0-8641-dd3182b273bc,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=d18a3c48-8be7-45c0-8641-dd3182b273bc,segment=NetworkSegment(94789acf-3520-42cb-8735-238d89a1ebc7),segment_id=94789acf-3520-42cb-8735-238d89a1ebc7)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:01:46.581242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-31a6bdd2-0f96-4719-b1ef-3faf7888c7c9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (d18a3c48-8be7-45c0-8641-dd3182b273bc), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:46.599045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-44fb7f47-c565-4dc5-8688-70a580d632cd admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:01:45Z,data_plane_status=None,description='',device_id='cae7a7b0-7257-44af-9007-c672b2882cca',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92,mac_address=fa:16:3e:11:dd:6b,name='',network_id=62195cd6-54fa-4e24-9d47-ae0de6356ac2,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T01:01:45Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:46.602264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-44fb7f47-c565-4dc5-8688-70a580d632cd admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:46.683054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a8d6e2fb-9911-45b6-a46a-3d218a5c7b9b","insert","tapd18a3c48-8b",["set",[]],["map",[["attached-mac","fa:16:3e:61:db:45"],["iface-id","d18a3c48-8be7-45c0-8641-dd3182b273bc"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:01:46.693219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a8d6e2fb-9911-45b6-a46a-3d218a5c7b9b","old",null,["set",[]],null],["","new","tapd18a3c48-8b",30,["map",[["attached-mac","fa:16:3e:61:db:45"],["iface-id","d18a3c48-8be7-45c0-8641-dd3182b273bc"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:01:46.833222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port b7527175-254d-4003-8922-2e8834ba4a91 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:01:46.833849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (b7527175-254d-4003-8922-2e8834ba4a91), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:48.103557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:428 started Sep 25 01:01:48.108292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e06d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=833000000,duration_sec=870,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:48.110654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:01:48.111462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:428 - starting polling. Elapsed:0.008 Sep 25 01:01:48.114547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:48.129680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:428 - port information retrieved. Elapsed:0.026 Sep 25 01:01:48.131090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', 'd18a3c48-8be7-45c0-8641-dd3182b273bc', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', '312a0875-9d08-4c94-b6f3-3135500afa6a', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '4a688d1f-1335-463f-b319-bcba153c442f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', 'de4727a2-569d-44c6-a53e-ecc89817f610'}, 'added': {'d18a3c48-8be7-45c0-8641-dd3182b273bc'}, 'removed': set(), 'updated': {'d18a3c48-8be7-45c0-8641-dd3182b273bc'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:01:48.134316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': 'd18a3c48-8be7-45c0-8641-dd3182b273bc', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-c62c61a7-64ad-4bd4-8ce7-b21b978664a6', 'network_id': 'c62c61a7-64ad-4bd4-8ce7-b21b978664a6', 'port_id': 'd18a3c48-8be7-45c0-8641-dd3182b273bc', 'mac_address': 'fa:16:3e:61:db:45', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 98, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '3a3c28a1-4968-4492-967d-c258b7838096', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 01:01:48.142357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: d18a3c48-8be7-45c0-8641-dd3182b273bc {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 01:01:48.143653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port d18a3c48-8be7-45c0-8641-dd3182b273bc updated. Details: {'device': 'd18a3c48-8be7-45c0-8641-dd3182b273bc', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-c62c61a7-64ad-4bd4-8ce7-b21b978664a6', 'network_id': 'c62c61a7-64ad-4bd4-8ce7-b21b978664a6', 'port_id': 'd18a3c48-8be7-45c0-8641-dd3182b273bc', 'mac_address': 'fa:16:3e:61:db:45', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 98, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '3a3c28a1-4968-4492-967d-c258b7838096', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 25 01:01:48.147380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Assigning 12 as local vlan for net-id=c62c61a7-64ad-4bd4-8ce7-b21b978664a6, seg-id=98 Sep 25 01:01:48.168412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xa5d7ab54,OFPFlowMod(buffer_id=4294967295,command=0,cookie=13979250796582379444,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4194), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4108}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:48.177642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x7834e06f,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4108)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4194}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:48.179824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapd18a3c48-8b, col_values=(('tag', 12),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:01:48.182116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapd18a3c48-8b, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:01:48.183213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapd18a3c48-8b, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:01:48.208059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapd18a3c48-8b, col_values=(('other_config', {'net_uuid': 'c62c61a7-64ad-4bd4-8ce7-b21b978664a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '12', 'segmentation_id': '98'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:01:48.249924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e071,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 30}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:48.250499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:428 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 17 devices currently available. Time elapsed: 0.119 Sep 25 01:01:48.251330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing device filters for 1 new devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 25 01:01:48.252057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing filters for devices {'d18a3c48-8be7-45c0-8641-dd3182b273bc'} Sep 25 01:01:48.254391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 01:01:48.258051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 01:01:48.282402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:01:48.381568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e1d6a6-78a8-4afb-9119-e75f68a3b07e]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:01:48.382459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:428 - agent port security group processed in 0.251 Sep 25 01:01:48.384256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for d18a3c48-8be7-45c0-8641-dd3182b273bc to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 01:01:48.990443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-56e1560a-fd9b-4808-ba74-f040ac92d427 None None] Resource Port d18a3c48-8be7-45c0-8641-dd3182b273bc updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:01:48.996408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-56e1560a-fd9b-4808-ba74-f040ac92d427 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (d18a3c48-8be7-45c0-8641-dd3182b273bc), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:49.025306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['d18a3c48-8be7-45c0-8641-dd3182b273bc'] and devices down [] completed. Sep 25 01:01:49.026747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:428 - ports processed. Elapsed:0.923 Sep 25 01:01:49.027299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:428 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.924 Sep 25 01:01:50.104948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:429 started Sep 25 01:01:50.112464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e073,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=836000000,duration_sec=872,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:50.114124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:01:50.115110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:429 - starting polling. Elapsed:0.010 Sep 25 01:01:50.126727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:50.151712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:429 - port information retrieved. Elapsed:0.045 Sep 25 01:01:50.153083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', 'd18a3c48-8be7-45c0-8641-dd3182b273bc', '312a0875-9d08-4c94-b6f3-3135500afa6a', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '4a688d1f-1335-463f-b319-bcba153c442f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'de4727a2-569d-44c6-a53e-ecc89817f610'}, 'added': set(), 'removed': set(), 'updated': {'d18a3c48-8be7-45c0-8641-dd3182b273bc'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:01:50.164235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': 'd18a3c48-8be7-45c0-8641-dd3182b273bc', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-c62c61a7-64ad-4bd4-8ce7-b21b978664a6', 'network_id': 'c62c61a7-64ad-4bd4-8ce7-b21b978664a6', 'port_id': 'd18a3c48-8be7-45c0-8641-dd3182b273bc', 'mac_address': 'fa:16:3e:61:db:45', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 98, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '3a3c28a1-4968-4492-967d-c258b7838096', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 01:01:50.185963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: d18a3c48-8be7-45c0-8641-dd3182b273bc {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 01:01:50.186869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port d18a3c48-8be7-45c0-8641-dd3182b273bc updated. Details: {'device': 'd18a3c48-8be7-45c0-8641-dd3182b273bc', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-c62c61a7-64ad-4bd4-8ce7-b21b978664a6', 'network_id': 'c62c61a7-64ad-4bd4-8ce7-b21b978664a6', 'port_id': 'd18a3c48-8be7-45c0-8641-dd3182b273bc', 'mac_address': 'fa:16:3e:61:db:45', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 98, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '3a3c28a1-4968-4492-967d-c258b7838096', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 12} Sep 25 01:01:50.191980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapd18a3c48-8b, col_values=(('tag', 12),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:01:50.197022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapd18a3c48-8b, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:01:50.198115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapd18a3c48-8b, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:01:50.199137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 01:01:50.202046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapd18a3c48-8b, col_values=(('other_config', {'net_uuid': 'c62c61a7-64ad-4bd4-8ce7-b21b978664a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '98', 'tag': '12'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:01:50.207975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 01:01:50.221200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e075,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 30}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:50.222519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:429 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 17 devices currently available. Time elapsed: 0.069 Sep 25 01:01:50.226312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refreshing firewall for 1 devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 25 01:01:50.227787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refresh firewall rules Sep 25 01:01:50.237424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 01:01:50.237949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 01:01:50.247161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:01:50.357251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df868fc-e6f6-4773-bbe2-fd9547a55423]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:01:50.359387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:429 - agent port security group processed in 0.205 Sep 25 01:01:50.361774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for d18a3c48-8be7-45c0-8641-dd3182b273bc to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 01:01:51.390513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port e90855c6-13bf-47db-8fb7-7226a222a0c7 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:01:51.393829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (e90855c6-13bf-47db-8fb7-7226a222a0c7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:51.410474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['d18a3c48-8be7-45c0-8641-dd3182b273bc'] and devices down [] completed. Sep 25 01:01:51.411857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:429 - ports processed. Elapsed:1.307 Sep 25 01:01:51.417082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:429 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:1.309 Sep 25 01:01:51.709000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1b1d0abf-1bd1-4431-a35e-4f6eea4f74b7 None None] Resource Port c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:01:51.709792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1b1d0abf-1bd1-4431-a35e-4f6eea4f74b7 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:51.979303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-823bb129-06da-4912-92a5-7b983339a69a admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:01:50Z,data_plane_status=None,description='',device_id='cae7a7b0-7257-44af-9007-c672b2882cca',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=d1013a6f-ee2d-46c6-9579-1abeb6086893,mac_address=fa:16:3e:60:3d:46,name='',network_id=c62c61a7-64ad-4bd4-8ce7-b21b978664a6,numa_affinity_policy=,project_id='69a3d6ce251e480d866a86ed9f6f2eb9',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(d1013a6f-ee2d-46c6-9579-1abeb6086893),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T01:01:51Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:51.983684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-823bb129-06da-4912-92a5-7b983339a69a admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (d1013a6f-ee2d-46c6-9579-1abeb6086893), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:52.110641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:430 started Sep 25 01:01:52.115326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e077,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=840000000,duration_sec=874,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:52.116393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:01:52.117056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:430 - starting polling. Elapsed:0.008 Sep 25 01:01:52.130816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:52.157170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:430 - port information retrieved. Elapsed:0.047 Sep 25 01:01:52.157777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:430 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.048 Sep 25 01:01:52.183470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port b7527175-254d-4003-8922-2e8834ba4a91 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:01:52.184044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (b7527175-254d-4003-8922-2e8834ba4a91), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:52.416064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1b1d0abf-1bd1-4431-a35e-4f6eea4f74b7 None None] Resource Port c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:01:52.419282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1b1d0abf-1bd1-4431-a35e-4f6eea4f74b7 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:53.708776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-823bb129-06da-4912-92a5-7b983339a69a admin admin] Received resource Port update without any changes: d1013a6f-ee2d-46c6-9579-1abeb6086893 {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 25 01:01:54.111123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:431 started Sep 25 01:01:54.115714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e079,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=840000000,duration_sec=876,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:54.119554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:01:54.120304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:431 - starting polling. Elapsed:0.009 Sep 25 01:01:54.123878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:54.129040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:431 - port information retrieved. Elapsed:0.018 Sep 25 01:01:54.129980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:431 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.019 Sep 25 01:01:54.301326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["1c908142-db11-4eab-9327-e018cb1a7113","insert","qg-c78ccb6c-0f",["set",[]],["map",[["attached-mac","fa:16:3e:11:dd:6b"],["iface-id","c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:01:54.354299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["1c908142-db11-4eab-9327-e018cb1a7113","old",null,["set",[]],null],["","new","qg-c78ccb6c-0f",31,["map",[["attached-mac","fa:16:3e:11:dd:6b"],["iface-id","c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:01:56.112803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:432 started Sep 25 01:01:56.119623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e07b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=843000000,duration_sec=878,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:56.120982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:01:56.122092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:432 - starting polling. Elapsed:0.010 Sep 25 01:01:56.131567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:56.157437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:432 - port information retrieved. Elapsed:0.044 Sep 25 01:01:56.159947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', 'd18a3c48-8be7-45c0-8641-dd3182b273bc', '312a0875-9d08-4c94-b6f3-3135500afa6a', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '4a688d1f-1335-463f-b319-bcba153c442f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'de4727a2-569d-44c6-a53e-ecc89817f610', 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92'}, 'added': {'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:01:56.165391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92', 'device_id': 'cae7a7b0-7257-44af-9007-c672b2882cca', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92', 'mac_address': 'fa:16:3e:11:dd:6b', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.111'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 01:01:56.185103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 01:01:56.186268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92 updated. Details: {'device': 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92', 'device_id': 'cae7a7b0-7257-44af-9007-c672b2882cca', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92', 'mac_address': 'fa:16:3e:11:dd:6b', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.111'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 25 01:01:56.190935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-c78ccb6c-0f, col_values=(('tag', 2),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:01:56.193877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-c78ccb6c-0f, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:01:56.194842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-c78ccb6c-0f, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:01:56.219786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-c78ccb6c-0f, col_values=(('other_config', {'net_uuid': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:01:56.256796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e07d,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 31}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:56.257393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:432 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 18 devices currently available. Time elapsed: 0.096 Sep 25 01:01:56.261690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing device filters for 1 new devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 25 01:01:56.263300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing filters for devices {'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92'} Sep 25 01:01:56.265634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 01:01:56.270114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 01:01:56.289675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:01:56.419986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[66998336-2c69-4db5-a4b2-7764fa941207]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:01:56.420783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:432 - agent port security group processed in 0.259 Sep 25 01:01:56.423434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 01:01:57.393434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92'] and devices down [] completed. Sep 25 01:01:57.395237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:432 - ports processed. Elapsed:1.282 Sep 25 01:01:57.395875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:432 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:1.283 Sep 25 01:01:57.566623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Resource Port c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92 updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)], 'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:01:57.567172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:57.706183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1b5dd4b0-da61-4cfc-b85d-5a2c713c41a3 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:01:57Z,description='Default security group',id=da9886cd-bb3e-42c0-a6f1-6b10fccce334,is_default=True,name='default',project_id='2fcc4e24aaf24b7f8d61af98d0fd2431',revision_number=1,rules=[SecurityGroupRule(48d5056e-8433-413e-8245-1764cd4bd1b9),SecurityGroupRule(551fbaa8-0704-4080-91cb-0a9b046104d2),SecurityGroupRule(96bd6248-e739-42a5-8f1e-0aeeadab8f68),SecurityGroupRule(a4feb820-9dfa-48e0-9d67-dd0c3c220ee1)],shared=False,stateful=True,updated_at=2022-09-25T01:01:57Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:57.706577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1b5dd4b0-da61-4cfc-b85d-5a2c713c41a3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (da9886cd-bb3e-42c0-a6f1-6b10fccce334), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:57.707509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1b5dd4b0-da61-4cfc-b85d-5a2c713c41a3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:01:57Z,description=,direction='egress',ethertype='IPv6',id=48d5056e-8433-413e-8245-1764cd4bd1b9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2fcc4e24aaf24b7f8d61af98d0fd2431',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=da9886cd-bb3e-42c0-a6f1-6b10fccce334,updated_at=2022-09-25T01:01:57Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:57.707953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1b5dd4b0-da61-4cfc-b85d-5a2c713c41a3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (48d5056e-8433-413e-8245-1764cd4bd1b9), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:57.708292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1b5dd4b0-da61-4cfc-b85d-5a2c713c41a3 admin admin] Security group rule updated ['da9886cd-bb3e-42c0-a6f1-6b10fccce334'] Sep 25 01:01:57.709161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1b5dd4b0-da61-4cfc-b85d-5a2c713c41a3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:01:57Z,description=,direction='ingress',ethertype='IPv6',id=551fbaa8-0704-4080-91cb-0a9b046104d2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2fcc4e24aaf24b7f8d61af98d0fd2431',protocol=,remote_address_group_id=,remote_group_id=da9886cd-bb3e-42c0-a6f1-6b10fccce334,remote_ip_prefix=,revision_number=0,security_group_id=da9886cd-bb3e-42c0-a6f1-6b10fccce334,updated_at=2022-09-25T01:01:57Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:57.709750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1b5dd4b0-da61-4cfc-b85d-5a2c713c41a3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (551fbaa8-0704-4080-91cb-0a9b046104d2), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:57.710256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1b5dd4b0-da61-4cfc-b85d-5a2c713c41a3 admin admin] Security group rule updated ['da9886cd-bb3e-42c0-a6f1-6b10fccce334'] Sep 25 01:01:57.715287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1b5dd4b0-da61-4cfc-b85d-5a2c713c41a3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:01:57Z,description=,direction='egress',ethertype='IPv4',id=96bd6248-e739-42a5-8f1e-0aeeadab8f68,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2fcc4e24aaf24b7f8d61af98d0fd2431',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=da9886cd-bb3e-42c0-a6f1-6b10fccce334,updated_at=2022-09-25T01:01:57Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:57.715802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1b5dd4b0-da61-4cfc-b85d-5a2c713c41a3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (96bd6248-e739-42a5-8f1e-0aeeadab8f68), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:57.716350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1b5dd4b0-da61-4cfc-b85d-5a2c713c41a3 admin admin] Security group rule updated ['da9886cd-bb3e-42c0-a6f1-6b10fccce334'] Sep 25 01:01:57.717086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1b5dd4b0-da61-4cfc-b85d-5a2c713c41a3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:01:57Z,description=,direction='ingress',ethertype='IPv4',id=a4feb820-9dfa-48e0-9d67-dd0c3c220ee1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2fcc4e24aaf24b7f8d61af98d0fd2431',protocol=,remote_address_group_id=,remote_group_id=da9886cd-bb3e-42c0-a6f1-6b10fccce334,remote_ip_prefix=,revision_number=0,security_group_id=da9886cd-bb3e-42c0-a6f1-6b10fccce334,updated_at=2022-09-25T01:01:57Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:57.717482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1b5dd4b0-da61-4cfc-b85d-5a2c713c41a3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (a4feb820-9dfa-48e0-9d67-dd0c3c220ee1), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:57.717821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1b5dd4b0-da61-4cfc-b85d-5a2c713c41a3 admin admin] Security group rule updated ['da9886cd-bb3e-42c0-a6f1-6b10fccce334'] Sep 25 01:01:57.829884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-74a81c7c-72a8-42d5-b1d2-2e6dfdb60ae9 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:01:57Z,description='Default security group',id=a6a4c5cf-00c7-4837-81b9-7c40498dd24f,is_default=True,name='default',project_id='c6554f9cd2bb4cdb96f76d1f87468962',revision_number=1,rules=[SecurityGroupRule(47b1b3cd-5697-459f-bd17-e4fee0ce50df),SecurityGroupRule(56cc82fe-c151-4ccf-8c65-b75e648a438e),SecurityGroupRule(7c42c298-1214-4f40-b6d8-b030840349f9),SecurityGroupRule(8a77c30a-804e-4b95-83dd-8166762a4868)],shared=False,stateful=True,updated_at=2022-09-25T01:01:57Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:57.831042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-74a81c7c-72a8-42d5-b1d2-2e6dfdb60ae9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (a6a4c5cf-00c7-4837-81b9-7c40498dd24f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:57.833238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-74a81c7c-72a8-42d5-b1d2-2e6dfdb60ae9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:01:57Z,description=,direction='ingress',ethertype='IPv6',id=47b1b3cd-5697-459f-bd17-e4fee0ce50df,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c6554f9cd2bb4cdb96f76d1f87468962',protocol=,remote_address_group_id=,remote_group_id=a6a4c5cf-00c7-4837-81b9-7c40498dd24f,remote_ip_prefix=,revision_number=0,security_group_id=a6a4c5cf-00c7-4837-81b9-7c40498dd24f,updated_at=2022-09-25T01:01:57Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:57.839984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-74a81c7c-72a8-42d5-b1d2-2e6dfdb60ae9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (47b1b3cd-5697-459f-bd17-e4fee0ce50df), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:57.841127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-74a81c7c-72a8-42d5-b1d2-2e6dfdb60ae9 admin admin] Security group rule updated ['a6a4c5cf-00c7-4837-81b9-7c40498dd24f'] Sep 25 01:01:57.848358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-74a81c7c-72a8-42d5-b1d2-2e6dfdb60ae9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:01:57Z,description=,direction='ingress',ethertype='IPv4',id=56cc82fe-c151-4ccf-8c65-b75e648a438e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c6554f9cd2bb4cdb96f76d1f87468962',protocol=,remote_address_group_id=,remote_group_id=a6a4c5cf-00c7-4837-81b9-7c40498dd24f,remote_ip_prefix=,revision_number=0,security_group_id=a6a4c5cf-00c7-4837-81b9-7c40498dd24f,updated_at=2022-09-25T01:01:57Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:57.852327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-74a81c7c-72a8-42d5-b1d2-2e6dfdb60ae9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (56cc82fe-c151-4ccf-8c65-b75e648a438e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:57.854566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-74a81c7c-72a8-42d5-b1d2-2e6dfdb60ae9 admin admin] Security group rule updated ['a6a4c5cf-00c7-4837-81b9-7c40498dd24f'] Sep 25 01:01:57.856480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-74a81c7c-72a8-42d5-b1d2-2e6dfdb60ae9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:01:57Z,description=,direction='egress',ethertype='IPv6',id=7c42c298-1214-4f40-b6d8-b030840349f9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c6554f9cd2bb4cdb96f76d1f87468962',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a6a4c5cf-00c7-4837-81b9-7c40498dd24f,updated_at=2022-09-25T01:01:57Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:57.861904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-74a81c7c-72a8-42d5-b1d2-2e6dfdb60ae9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (7c42c298-1214-4f40-b6d8-b030840349f9), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:57.863895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-74a81c7c-72a8-42d5-b1d2-2e6dfdb60ae9 admin admin] Security group rule updated ['a6a4c5cf-00c7-4837-81b9-7c40498dd24f'] Sep 25 01:01:57.869561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-74a81c7c-72a8-42d5-b1d2-2e6dfdb60ae9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:01:57Z,description=,direction='egress',ethertype='IPv4',id=8a77c30a-804e-4b95-83dd-8166762a4868,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c6554f9cd2bb4cdb96f76d1f87468962',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a6a4c5cf-00c7-4837-81b9-7c40498dd24f,updated_at=2022-09-25T01:01:57Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:57.870721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-74a81c7c-72a8-42d5-b1d2-2e6dfdb60ae9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (8a77c30a-804e-4b95-83dd-8166762a4868), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:57.873290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-74a81c7c-72a8-42d5-b1d2-2e6dfdb60ae9 admin admin] Security group rule updated ['a6a4c5cf-00c7-4837-81b9-7c40498dd24f'] Sep 25 01:01:58.027208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1b5dd4b0-da61-4cfc-b85d-5a2c713c41a3 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-25T01:01:57Z,description='',dns_domain=None,id=09798d2d-0271-466c-9c29-d981c8d4721a,mtu=1500,name='tempest-TestShelveInstance-144035538-network',project_id='2fcc4e24aaf24b7f8d61af98d0fd2431',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(09798d2d-0271-466c-9c29-d981c8d4721a),segments=[NetworkSegment(1a5d6abd-d257-4ac1-9e42-36c802984848)],shared=False,status='ACTIVE',updated_at=2022-09-25T01:01:57Z,vlan_transparent=) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:58.028488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1b5dd4b0-da61-4cfc-b85d-5a2c713c41a3 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (09798d2d-0271-466c-9c29-d981c8d4721a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:58.114772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:433 started Sep 25 01:01:58.121695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e07f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=844000000,duration_sec=880,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:58.123206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:01:58.124219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:433 - starting polling. Elapsed:0.010 Sep 25 01:01:58.129603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:58.156554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:433 - port information retrieved. Elapsed:0.042 Sep 25 01:01:58.162113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', 'd18a3c48-8be7-45c0-8641-dd3182b273bc', '312a0875-9d08-4c94-b6f3-3135500afa6a', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '4a688d1f-1335-463f-b319-bcba153c442f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'de4727a2-569d-44c6-a53e-ecc89817f610', 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92'}, 'added': set(), 'removed': set(), 'updated': {'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:01:58.169469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92', 'device_id': 'cae7a7b0-7257-44af-9007-c672b2882cca', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92', 'mac_address': 'fa:16:3e:11:dd:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.111'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 01:01:58.184790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 01:01:58.185588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92 updated. Details: {'device': 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92', 'device_id': 'cae7a7b0-7257-44af-9007-c672b2882cca', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92', 'mac_address': 'fa:16:3e:11:dd:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.111'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 25 01:01:58.186967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-c78ccb6c-0f, col_values=(('tag', 2),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:01:58.187671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-c78ccb6c-0f, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:01:58.189217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-c78ccb6c-0f, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:01:58.192749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 01:01:58.198105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-c78ccb6c-0f, col_values=(('other_config', {'net_uuid': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:01:58.201984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 01:01:58.210816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e081,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 31}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:01:58.211786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:433 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 18 devices currently available. Time elapsed: 0.047 Sep 25 01:01:58.212342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refreshing firewall for 1 devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 25 01:01:58.217421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refresh firewall rules Sep 25 01:01:58.219187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 01:01:58.219694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 01:01:58.231272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:01:58.322195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa04a2b-b94e-4274-b5fc-cd4bfe2a5466]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:01:58.325479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:433 - agent port security group processed in 0.160 Sep 25 01:01:58.328867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 01:01:58.514720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager [None req-1b5dd4b0-da61-4cfc-b85d-5a2c713c41a3 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 09798d2d-0271-466c-9c29-d981c8d4721a with segmentation id not found. Sep 25 01:01:58.514720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 25 01:01:58.514720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 25 01:01:58.514720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 25 01:01:58.514720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 25 01:01:58.514720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 25 01:01:58.514720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 25 01:01:58.514720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 25 01:01:58.514720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 25 01:01:58.514720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 25 01:01:58.514720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 25 01:01:58.514720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 25 01:01:58.514720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 25 01:01:58.516167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 25 01:01:58.516167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 25 01:01:58.516167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 25 01:01:58.516167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 09798d2d-0271-466c-9c29-d981c8d4721a with segmentation id not found. Sep 25 01:01:58.516167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Sep 25 01:01:58.811360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92'] and devices down [] completed. Sep 25 01:01:58.812058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:433 - ports processed. Elapsed:0.698 Sep 25 01:01:58.812782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:433 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.699 Sep 25 01:01:58.953656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0242c4c9-da87-411e-8769-dc1c7a37f2e5 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(a1c573fd-5166-471e-8e6d-fea0b125c8a5)],cidr=172.20.0.0/28,created_at=2022-09-25T01:01:58Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=8411f93b-86a3-4016-8215-1e4f10f0027b,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestShelveInstance-144035538-subnet',network_id=09798d2d-0271-466c-9c29-d981c8d4721a,project_id='2fcc4e24aaf24b7f8d61af98d0fd2431',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-25T01:01:58Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:01:58.955020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0242c4c9-da87-411e-8769-dc1c7a37f2e5 admin admin] Publish callbacks [] for Subnet (8411f93b-86a3-4016-8215-1e4f10f0027b), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:59.317065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3293a83b-d61d-4412-b29b-b5b1db2d2850 admin admin] Resource SecurityGroup deleted: a6a4c5cf-00c7-4837-81b9-7c40498dd24f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:59.317974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3293a83b-d61d-4412-b29b-b5b1db2d2850 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (a6a4c5cf-00c7-4837-81b9-7c40498dd24f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:59.318796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3293a83b-d61d-4412-b29b-b5b1db2d2850 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('a6a4c5cf-00c7-4837-81b9-7c40498dd24f',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:01:59.440580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3293a83b-d61d-4412-b29b-b5b1db2d2850 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('a6a4c5cf-00c7-4837-81b9-7c40498dd24f',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:01:59.441493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3293a83b-d61d-4412-b29b-b5b1db2d2850 admin admin] Resource SecurityGroupRule deleted: 47b1b3cd-5697-459f-bd17-e4fee0ce50df {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:59.442521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3293a83b-d61d-4412-b29b-b5b1db2d2850 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (47b1b3cd-5697-459f-bd17-e4fee0ce50df), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:59.443325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-3293a83b-d61d-4412-b29b-b5b1db2d2850 admin admin] Security group rule updated ['a6a4c5cf-00c7-4837-81b9-7c40498dd24f'] Sep 25 01:01:59.444337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3293a83b-d61d-4412-b29b-b5b1db2d2850 admin admin] Resource SecurityGroupRule deleted: 56cc82fe-c151-4ccf-8c65-b75e648a438e {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:59.446727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3293a83b-d61d-4412-b29b-b5b1db2d2850 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (56cc82fe-c151-4ccf-8c65-b75e648a438e), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:59.447742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-3293a83b-d61d-4412-b29b-b5b1db2d2850 admin admin] Security group rule updated ['a6a4c5cf-00c7-4837-81b9-7c40498dd24f'] Sep 25 01:01:59.448824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3293a83b-d61d-4412-b29b-b5b1db2d2850 admin admin] Resource SecurityGroupRule deleted: 7c42c298-1214-4f40-b6d8-b030840349f9 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:59.449779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3293a83b-d61d-4412-b29b-b5b1db2d2850 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (7c42c298-1214-4f40-b6d8-b030840349f9), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:59.453021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-3293a83b-d61d-4412-b29b-b5b1db2d2850 admin admin] Security group rule updated ['a6a4c5cf-00c7-4837-81b9-7c40498dd24f'] Sep 25 01:01:59.454545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3293a83b-d61d-4412-b29b-b5b1db2d2850 admin admin] Resource SecurityGroupRule deleted: 8a77c30a-804e-4b95-83dd-8166762a4868 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:01:59.455420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3293a83b-d61d-4412-b29b-b5b1db2d2850 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (8a77c30a-804e-4b95-83dd-8166762a4868), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:01:59.456597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-3293a83b-d61d-4412-b29b-b5b1db2d2850 admin admin] Security group rule updated ['a6a4c5cf-00c7-4837-81b9-7c40498dd24f'] Sep 25 01:01:59.712001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1a672875-a2a7-4540-a003-ad69699fe83b None None] Resource Port d1013a6f-ee2d-46c6-9579-1abeb6086893 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=d1013a6f-ee2d-46c6-9579-1abeb6086893,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=d1013a6f-ee2d-46c6-9579-1abeb6086893,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:01:59.713752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1a672875-a2a7-4540-a003-ad69699fe83b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (d1013a6f-ee2d-46c6-9579-1abeb6086893), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:00.115625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:434 started Sep 25 01:02:00.121293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e083,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=846000000,duration_sec=882,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:00.122901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:02:00.123817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:434 - starting polling. Elapsed:0.008 Sep 25 01:02:00.136468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:00.188123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:434 - port information retrieved. Elapsed:0.062 Sep 25 01:02:00.188843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:434 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.073 Sep 25 01:02:00.459173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1a672875-a2a7-4540-a003-ad69699fe83b None None] Resource Port d1013a6f-ee2d-46c6-9579-1abeb6086893 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=d1013a6f-ee2d-46c6-9579-1abeb6086893,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=d1013a6f-ee2d-46c6-9579-1abeb6086893,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=d1013a6f-ee2d-46c6-9579-1abeb6086893,segment=NetworkSegment(94789acf-3520-42cb-8735-238d89a1ebc7),segment_id=94789acf-3520-42cb-8735-238d89a1ebc7)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:02:00.460425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1a672875-a2a7-4540-a003-ad69699fe83b None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (d1013a6f-ee2d-46c6-9579-1abeb6086893), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:00.583307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6facf9ae-3274-4c36-bd59-02d295be18ba tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:01:59Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=6d29a34f-6d17-4ad7-bb52-9a884e6f97c8,mac_address=fa:16:3e:c6:97:11,name='',network_id=62195cd6-54fa-4e24-9d47-ae0de6356ac2,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(6d29a34f-6d17-4ad7-bb52-9a884e6f97c8),security_group_ids=set([]),status='N/A',updated_at=2022-09-25T01:01:59Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:00.584536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6facf9ae-3274-4c36-bd59-02d295be18ba tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (6d29a34f-6d17-4ad7-bb52-9a884e6f97c8), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:01.208920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["fb714898-a2fd-4ee0-bc94-a1ab9e64b4f1","insert","qr-d1013a6f-ee",["set",[]],["map",[["attached-mac","fa:16:3e:60:3d:46"],["iface-id","d1013a6f-ee2d-46c6-9579-1abeb6086893"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:02:01.226988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["fb714898-a2fd-4ee0-bc94-a1ab9e64b4f1","old",null,["set",[]],null],["","new","qr-d1013a6f-ee",32,["map",[["attached-mac","fa:16:3e:60:3d:46"],["iface-id","d1013a6f-ee2d-46c6-9579-1abeb6086893"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:02:01.978490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8ee173ba-7b28-4809-8f29-f486f3497712 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:02:00Z,description='Default security group',id=6008b304-bca6-4462-819f-86e8294582d0,is_default=True,name='default',project_id='2ec79525454f495dadd6199cdcfdc8fb',revision_number=1,rules=[SecurityGroupRule(21d6a465-204f-4de4-bcc1-a12dddcb1945),SecurityGroupRule(51e4a9dd-757a-44ee-a512-8a4caaa6fd53),SecurityGroupRule(7ad856c8-dad4-4d19-a29d-a24b68374450),SecurityGroupRule(c93191b0-6869-4678-821e-5551ff404471)],shared=False,stateful=True,updated_at=2022-09-25T01:02:00Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:01.980629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8ee173ba-7b28-4809-8f29-f486f3497712 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (6008b304-bca6-4462-819f-86e8294582d0), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:01.980629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8ee173ba-7b28-4809-8f29-f486f3497712 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:00Z,description=,direction='egress',ethertype='IPv4',id=21d6a465-204f-4de4-bcc1-a12dddcb1945,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2ec79525454f495dadd6199cdcfdc8fb',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6008b304-bca6-4462-819f-86e8294582d0,updated_at=2022-09-25T01:02:00Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:01.984292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8ee173ba-7b28-4809-8f29-f486f3497712 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (21d6a465-204f-4de4-bcc1-a12dddcb1945), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:01.990231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8ee173ba-7b28-4809-8f29-f486f3497712 admin admin] Security group rule updated ['6008b304-bca6-4462-819f-86e8294582d0'] Sep 25 01:02:01.990878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8ee173ba-7b28-4809-8f29-f486f3497712 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:00Z,description=,direction='egress',ethertype='IPv6',id=51e4a9dd-757a-44ee-a512-8a4caaa6fd53,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2ec79525454f495dadd6199cdcfdc8fb',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6008b304-bca6-4462-819f-86e8294582d0,updated_at=2022-09-25T01:02:00Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:01.992386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8ee173ba-7b28-4809-8f29-f486f3497712 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (51e4a9dd-757a-44ee-a512-8a4caaa6fd53), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:01.993216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8ee173ba-7b28-4809-8f29-f486f3497712 admin admin] Security group rule updated ['6008b304-bca6-4462-819f-86e8294582d0'] Sep 25 01:02:01.999240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8ee173ba-7b28-4809-8f29-f486f3497712 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:00Z,description=,direction='ingress',ethertype='IPv6',id=7ad856c8-dad4-4d19-a29d-a24b68374450,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2ec79525454f495dadd6199cdcfdc8fb',protocol=,remote_address_group_id=,remote_group_id=6008b304-bca6-4462-819f-86e8294582d0,remote_ip_prefix=,revision_number=0,security_group_id=6008b304-bca6-4462-819f-86e8294582d0,updated_at=2022-09-25T01:02:00Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:02.000379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8ee173ba-7b28-4809-8f29-f486f3497712 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (7ad856c8-dad4-4d19-a29d-a24b68374450), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:02.001233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8ee173ba-7b28-4809-8f29-f486f3497712 admin admin] Security group rule updated ['6008b304-bca6-4462-819f-86e8294582d0'] Sep 25 01:02:02.003137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8ee173ba-7b28-4809-8f29-f486f3497712 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:00Z,description=,direction='ingress',ethertype='IPv4',id=c93191b0-6869-4678-821e-5551ff404471,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2ec79525454f495dadd6199cdcfdc8fb',protocol=,remote_address_group_id=,remote_group_id=6008b304-bca6-4462-819f-86e8294582d0,remote_ip_prefix=,revision_number=0,security_group_id=6008b304-bca6-4462-819f-86e8294582d0,updated_at=2022-09-25T01:02:00Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:02.005878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8ee173ba-7b28-4809-8f29-f486f3497712 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (c93191b0-6869-4678-821e-5551ff404471), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:02.006842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8ee173ba-7b28-4809-8f29-f486f3497712 admin admin] Security group rule updated ['6008b304-bca6-4462-819f-86e8294582d0'] Sep 25 01:02:02.091667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6facf9ae-3274-4c36-bd59-02d295be18ba tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Resource Port 6d29a34f-6d17-4ad7-bb52-9a884e6f97c8 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'a9f6e5a5-d118-4823-a095-297dfc4f629f'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:02:02.092713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6facf9ae-3274-4c36-bd59-02d295be18ba tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (6d29a34f-6d17-4ad7-bb52-9a884e6f97c8), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:02.120044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:435 started Sep 25 01:02:02.128984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e085,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=850000000,duration_sec=884,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:02.132405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:02:02.144159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:435 - starting polling. Elapsed:0.019 Sep 25 01:02:02.154347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:02.170996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:435 - port information retrieved. Elapsed:0.051 Sep 25 01:02:02.172040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'd18a3c48-8be7-45c0-8641-dd3182b273bc', '312a0875-9d08-4c94-b6f3-3135500afa6a', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '4a688d1f-1335-463f-b319-bcba153c442f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'de4727a2-569d-44c6-a53e-ecc89817f610', 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92'}, 'added': {'d1013a6f-ee2d-46c6-9579-1abeb6086893'}, 'removed': set(), 'updated': {'d1013a6f-ee2d-46c6-9579-1abeb6086893'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:02:02.174694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'device_id': 'cae7a7b0-7257-44af-9007-c672b2882cca', 'network_id': 'c62c61a7-64ad-4bd4-8ce7-b21b978664a6', 'port_id': 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'mac_address': 'fa:16:3e:60:3d:46', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 98, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '3a3c28a1-4968-4492-967d-c258b7838096', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 01:02:02.189155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: d1013a6f-ee2d-46c6-9579-1abeb6086893 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 01:02:02.189639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port d1013a6f-ee2d-46c6-9579-1abeb6086893 updated. Details: {'device': 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'device_id': 'cae7a7b0-7257-44af-9007-c672b2882cca', 'network_id': 'c62c61a7-64ad-4bd4-8ce7-b21b978664a6', 'port_id': 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'mac_address': 'fa:16:3e:60:3d:46', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 98, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '3a3c28a1-4968-4492-967d-c258b7838096', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 12} Sep 25 01:02:02.195981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-d1013a6f-ee, col_values=(('tag', 12),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:02:02.196559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-d1013a6f-ee, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:02:02.197026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-d1013a6f-ee, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:02:02.210338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-d1013a6f-ee, col_values=(('other_config', {'net_uuid': 'c62c61a7-64ad-4bd4-8ce7-b21b978664a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '12', 'segmentation_id': '98'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:02:02.247481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e087,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 32}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:02.247863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:435 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.075 Sep 25 01:02:02.248413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing device filters for 1 new devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 25 01:02:02.248875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing filters for devices {'d1013a6f-ee2d-46c6-9579-1abeb6086893'} Sep 25 01:02:02.253514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 01:02:02.256872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 01:02:02.276124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:02:02.330165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d7f560ff-5667-41c5-ab9c-d65dd9866127 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:01:59Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-09798d2d-0271-466c-9c29-d981c8d4721a',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=71ee88f3-d4ca-4676-ab1f-7494784204fa,mac_address=fa:16:3e:54:18:4f,name='',network_id=09798d2d-0271-466c-9c29-d981c8d4721a,numa_affinity_policy=,project_id='2fcc4e24aaf24b7f8d61af98d0fd2431',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(71ee88f3-d4ca-4676-ab1f-7494784204fa),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T01:02:01Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:02.330986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d7f560ff-5667-41c5-ab9c-d65dd9866127 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (71ee88f3-d4ca-4676-ab1f-7494784204fa), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:02.413548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cc61ef-ba90-4b90-b99d-4740315ccca8]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:02:02.414720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:435 - agent port security group processed in 0.242 Sep 25 01:02:02.416100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for d1013a6f-ee2d-46c6-9579-1abeb6086893 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 01:02:02.944681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d0338b73-9db3-4a73-8375-fec417faf94f None None] Resource Port d1013a6f-ee2d-46c6-9579-1abeb6086893 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:02:02.947187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d0338b73-9db3-4a73-8375-fec417faf94f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (d1013a6f-ee2d-46c6-9579-1abeb6086893), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:03.862895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['d1013a6f-ee2d-46c6-9579-1abeb6086893'] and devices down [] completed. Sep 25 01:02:03.863566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:435 - ports processed. Elapsed:1.744 Sep 25 01:02:03.864265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:435 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:1.744 Sep 25 01:02:03.911085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-dcaedd17-5fee-4cc2-9967-65fd77db2aa7 admin admin] Resource SecurityGroup deleted: 6008b304-bca6-4462-819f-86e8294582d0 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:03.911692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-dcaedd17-5fee-4cc2-9967-65fd77db2aa7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (6008b304-bca6-4462-819f-86e8294582d0), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:03.913809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcaedd17-5fee-4cc2-9967-65fd77db2aa7 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('6008b304-bca6-4462-819f-86e8294582d0',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:02:03.940389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0be2ff11-74ac-44a9-ae7d-3bf65a8022fd admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:02:02Z,data_plane_status=None,description='',device_id='29892cf5-05ed-4772-a3c7-758374b46435',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=41a4501b-2acb-4e3d-a37d-bedbcdc6c76d,mac_address=fa:16:3e:9d:76:4c,name='',network_id=62195cd6-54fa-4e24-9d47-ae0de6356ac2,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(41a4501b-2acb-4e3d-a37d-bedbcdc6c76d),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T01:02:02Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:03.940771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0be2ff11-74ac-44a9-ae7d-3bf65a8022fd admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (41a4501b-2acb-4e3d-a37d-bedbcdc6c76d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:03.951885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-dcaedd17-5fee-4cc2-9967-65fd77db2aa7 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('6008b304-bca6-4462-819f-86e8294582d0',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:02:03.954173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-dcaedd17-5fee-4cc2-9967-65fd77db2aa7 admin admin] Resource SecurityGroupRule deleted: 21d6a465-204f-4de4-bcc1-a12dddcb1945 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:03.956878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-dcaedd17-5fee-4cc2-9967-65fd77db2aa7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (21d6a465-204f-4de4-bcc1-a12dddcb1945), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:03.961177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-dcaedd17-5fee-4cc2-9967-65fd77db2aa7 admin admin] Security group rule updated ['6008b304-bca6-4462-819f-86e8294582d0'] Sep 25 01:02:03.962193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-dcaedd17-5fee-4cc2-9967-65fd77db2aa7 admin admin] Resource SecurityGroupRule deleted: 51e4a9dd-757a-44ee-a512-8a4caaa6fd53 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:03.965459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-dcaedd17-5fee-4cc2-9967-65fd77db2aa7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (51e4a9dd-757a-44ee-a512-8a4caaa6fd53), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:03.966071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-dcaedd17-5fee-4cc2-9967-65fd77db2aa7 admin admin] Security group rule updated ['6008b304-bca6-4462-819f-86e8294582d0'] Sep 25 01:02:03.969474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-dcaedd17-5fee-4cc2-9967-65fd77db2aa7 admin admin] Resource SecurityGroupRule deleted: 7ad856c8-dad4-4d19-a29d-a24b68374450 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:03.974351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-dcaedd17-5fee-4cc2-9967-65fd77db2aa7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (7ad856c8-dad4-4d19-a29d-a24b68374450), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:03.975187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-dcaedd17-5fee-4cc2-9967-65fd77db2aa7 admin admin] Security group rule updated ['6008b304-bca6-4462-819f-86e8294582d0'] Sep 25 01:02:03.975772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-dcaedd17-5fee-4cc2-9967-65fd77db2aa7 admin admin] Resource SecurityGroupRule deleted: c93191b0-6869-4678-821e-5551ff404471 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:03.976360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-dcaedd17-5fee-4cc2-9967-65fd77db2aa7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (c93191b0-6869-4678-821e-5551ff404471), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:03.976857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-dcaedd17-5fee-4cc2-9967-65fd77db2aa7 admin admin] Security group rule updated ['6008b304-bca6-4462-819f-86e8294582d0'] Sep 25 01:02:04.121168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:436 started Sep 25 01:02:04.126476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e089,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=850000000,duration_sec=886,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:04.127096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:02:04.127450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:436 - starting polling. Elapsed:0.006 Sep 25 01:02:04.131351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:04.145992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:436 - port information retrieved. Elapsed:0.016 Sep 25 01:02:04.148621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'd18a3c48-8be7-45c0-8641-dd3182b273bc', '312a0875-9d08-4c94-b6f3-3135500afa6a', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '4a688d1f-1335-463f-b319-bcba153c442f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'de4727a2-569d-44c6-a53e-ecc89817f610', 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92'}, 'added': set(), 'removed': set(), 'updated': {'d1013a6f-ee2d-46c6-9579-1abeb6086893'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:02:04.162281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'device_id': 'cae7a7b0-7257-44af-9007-c672b2882cca', 'network_id': 'c62c61a7-64ad-4bd4-8ce7-b21b978664a6', 'port_id': 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'mac_address': 'fa:16:3e:60:3d:46', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 98, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '3a3c28a1-4968-4492-967d-c258b7838096', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 01:02:04.182809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: d1013a6f-ee2d-46c6-9579-1abeb6086893 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 01:02:04.188092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port d1013a6f-ee2d-46c6-9579-1abeb6086893 updated. Details: {'device': 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'device_id': 'cae7a7b0-7257-44af-9007-c672b2882cca', 'network_id': 'c62c61a7-64ad-4bd4-8ce7-b21b978664a6', 'port_id': 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'mac_address': 'fa:16:3e:60:3d:46', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 98, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '3a3c28a1-4968-4492-967d-c258b7838096', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 12} Sep 25 01:02:04.195819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-d1013a6f-ee, col_values=(('tag', 12),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:02:04.198786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-d1013a6f-ee, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:02:04.202947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-d1013a6f-ee, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:02:04.204761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 01:02:04.214068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-d1013a6f-ee, col_values=(('other_config', {'net_uuid': 'c62c61a7-64ad-4bd4-8ce7-b21b978664a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '98', 'tag': '12'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:02:04.219785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 01:02:04.235281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e08b,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 32}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:04.239037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:436 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.089 Sep 25 01:02:04.241153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refreshing firewall for 1 devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 25 01:02:04.244024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refresh firewall rules Sep 25 01:02:04.253317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 01:02:04.253995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 01:02:04.289297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:02:04.426048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af31d20-34ab-404d-bdf3-7331105c2ab6]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:02:04.427068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:436 - agent port security group processed in 0.277 Sep 25 01:02:04.432147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for d1013a6f-ee2d-46c6-9579-1abeb6086893 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 01:02:04.503218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0232eb92-aef9-471e-b0f4-08e782f45189","insert","tap71ee88f3-d4",["set",[]],["map",[["attached-mac","fa:16:3e:54:18:4f"],["iface-id","71ee88f3-d4ca-4676-ab1f-7494784204fa"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:02:04.529391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0232eb92-aef9-471e-b0f4-08e782f45189","old",null,["set",[]],null],["","new","tap71ee88f3-d4",33,["map",[["attached-mac","fa:16:3e:54:18:4f"],["iface-id","71ee88f3-d4ca-4676-ab1f-7494784204fa"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:02:04.775146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d7f560ff-5667-41c5-ab9c-d65dd9866127 None None] Resource Port 71ee88f3-d4ca-4676-ab1f-7494784204fa updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=71ee88f3-d4ca-4676-ab1f-7494784204fa,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=71ee88f3-d4ca-4676-ab1f-7494784204fa,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=71ee88f3-d4ca-4676-ab1f-7494784204fa,segment=NetworkSegment(1a5d6abd-d257-4ac1-9e42-36c802984848),segment_id=1a5d6abd-d257-4ac1-9e42-36c802984848)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:02:04.775910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d7f560ff-5667-41c5-ab9c-d65dd9866127 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (71ee88f3-d4ca-4676-ab1f-7494784204fa), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:05.349872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['d1013a6f-ee2d-46c6-9579-1abeb6086893'] and devices down [] completed. Sep 25 01:02:05.351775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:436 - ports processed. Elapsed:1.230 Sep 25 01:02:05.359157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:436 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:1.238 Sep 25 01:02:06.128282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:437 started Sep 25 01:02:06.134181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e08d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=858000000,duration_sec=888,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:06.135308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:02:06.136533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:437 - starting polling. Elapsed:0.008 Sep 25 01:02:06.154226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:06.178936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:437 - port information retrieved. Elapsed:0.046 Sep 25 01:02:06.180116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'd18a3c48-8be7-45c0-8641-dd3182b273bc', '312a0875-9d08-4c94-b6f3-3135500afa6a', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '71ee88f3-d4ca-4676-ab1f-7494784204fa', '4a688d1f-1335-463f-b319-bcba153c442f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'de4727a2-569d-44c6-a53e-ecc89817f610', 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92'}, 'added': {'71ee88f3-d4ca-4676-ab1f-7494784204fa'}, 'removed': set(), 'updated': {'71ee88f3-d4ca-4676-ab1f-7494784204fa'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:02:06.186014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '71ee88f3-d4ca-4676-ab1f-7494784204fa', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-09798d2d-0271-466c-9c29-d981c8d4721a', 'network_id': '09798d2d-0271-466c-9c29-d981c8d4721a', 'port_id': '71ee88f3-d4ca-4676-ab1f-7494784204fa', 'mac_address': 'fa:16:3e:54:18:4f', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 70, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '8411f93b-86a3-4016-8215-1e4f10f0027b', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 01:02:06.204991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 71ee88f3-d4ca-4676-ab1f-7494784204fa {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 01:02:06.206829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 71ee88f3-d4ca-4676-ab1f-7494784204fa updated. Details: {'device': '71ee88f3-d4ca-4676-ab1f-7494784204fa', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-09798d2d-0271-466c-9c29-d981c8d4721a', 'network_id': '09798d2d-0271-466c-9c29-d981c8d4721a', 'port_id': '71ee88f3-d4ca-4676-ab1f-7494784204fa', 'mac_address': 'fa:16:3e:54:18:4f', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 70, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '8411f93b-86a3-4016-8215-1e4f10f0027b', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 25 01:02:06.208026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Assigning 13 as local vlan for net-id=09798d2d-0271-466c-9c29-d981c8d4721a, seg-id=70 Sep 25 01:02:06.216766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xa5d7ab56,OFPFlowMod(buffer_id=4294967295,command=0,cookie=13979250796582379444,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4166), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4109}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:06.226718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x7834e08f,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4109)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4166}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:06.228462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap71ee88f3-d4, col_values=(('tag', 13),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:02:06.229076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap71ee88f3-d4, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:02:06.233944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap71ee88f3-d4, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:02:06.259569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap71ee88f3-d4, col_values=(('other_config', {'net_uuid': '09798d2d-0271-466c-9c29-d981c8d4721a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '13', 'segmentation_id': '70'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:02:06.280260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e091,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 33}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:06.281337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:437 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 20 devices currently available. Time elapsed: 0.096 Sep 25 01:02:06.282175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing device filters for 1 new devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 25 01:02:06.282952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing filters for devices {'71ee88f3-d4ca-4676-ab1f-7494784204fa'} Sep 25 01:02:06.285473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 01:02:06.286270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 01:02:06.298456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:02:06.402954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e225eac1-f540-471c-8aae-840d2d14e030]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:02:06.405959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:437 - agent port security group processed in 0.220 Sep 25 01:02:06.407789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 71ee88f3-d4ca-4676-ab1f-7494784204fa to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 01:02:07.703507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['71ee88f3-d4ca-4676-ab1f-7494784204fa'] and devices down [] completed. Sep 25 01:02:07.705138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:437 - ports processed. Elapsed:1.577 Sep 25 01:02:07.705872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:437 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:1.578 Sep 25 01:02:07.844799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Resource Port 71ee88f3-d4ca-4676-ab1f-7494784204fa updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:02:07.845739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (71ee88f3-d4ca-4676-ab1f-7494784204fa), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:08.131028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:438 started Sep 25 01:02:08.136638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e093,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=861000000,duration_sec=890,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:08.151092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:02:08.153873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:438 - starting polling. Elapsed:0.021 Sep 25 01:02:08.188433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:08.207300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:438 - port information retrieved. Elapsed:0.075 Sep 25 01:02:08.208402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'd18a3c48-8be7-45c0-8641-dd3182b273bc', '312a0875-9d08-4c94-b6f3-3135500afa6a', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '71ee88f3-d4ca-4676-ab1f-7494784204fa', '4a688d1f-1335-463f-b319-bcba153c442f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'de4727a2-569d-44c6-a53e-ecc89817f610', 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92'}, 'added': set(), 'removed': set(), 'updated': {'71ee88f3-d4ca-4676-ab1f-7494784204fa'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:02:08.209652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '71ee88f3-d4ca-4676-ab1f-7494784204fa', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-09798d2d-0271-466c-9c29-d981c8d4721a', 'network_id': '09798d2d-0271-466c-9c29-d981c8d4721a', 'port_id': '71ee88f3-d4ca-4676-ab1f-7494784204fa', 'mac_address': 'fa:16:3e:54:18:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 70, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '8411f93b-86a3-4016-8215-1e4f10f0027b', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 01:02:08.228876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 71ee88f3-d4ca-4676-ab1f-7494784204fa {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 01:02:08.229545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 71ee88f3-d4ca-4676-ab1f-7494784204fa updated. Details: {'device': '71ee88f3-d4ca-4676-ab1f-7494784204fa', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-09798d2d-0271-466c-9c29-d981c8d4721a', 'network_id': '09798d2d-0271-466c-9c29-d981c8d4721a', 'port_id': '71ee88f3-d4ca-4676-ab1f-7494784204fa', 'mac_address': 'fa:16:3e:54:18:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 70, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '8411f93b-86a3-4016-8215-1e4f10f0027b', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 13} Sep 25 01:02:08.231463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap71ee88f3-d4, col_values=(('tag', 13),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:02:08.232287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap71ee88f3-d4, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:02:08.233035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap71ee88f3-d4, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:02:08.234097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 01:02:08.236414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap71ee88f3-d4, col_values=(('other_config', {'net_uuid': '09798d2d-0271-466c-9c29-d981c8d4721a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '70', 'tag': '13'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:02:08.238156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 01:02:08.244386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e095,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 33}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:08.245649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:438 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 20 devices currently available. Time elapsed: 0.036 Sep 25 01:02:08.246718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refreshing firewall for 1 devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 25 01:02:08.247739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refresh firewall rules Sep 25 01:02:08.250406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 01:02:08.251459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 01:02:08.263846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:02:08.345721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbd1cbd-3056-4988-b777-6615bdde7387]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:02:08.347263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:438 - agent port security group processed in 0.138 Sep 25 01:02:08.349329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 71ee88f3-d4ca-4676-ab1f-7494784204fa to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 01:02:09.387497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['71ee88f3-d4ca-4676-ab1f-7494784204fa'] and devices down [] completed. Sep 25 01:02:09.389908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:438 - ports processed. Elapsed:1.259 Sep 25 01:02:09.391300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:438 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:1.260 Sep 25 01:02:10.133152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:439 started Sep 25 01:02:10.137839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e097,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=862000000,duration_sec=892,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:10.138575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:02:10.138947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:439 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:02:10.211155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1ea822a7-55dd-4534-b53c-feff73605600 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:02:09Z,data_plane_status=None,description='',device_id='29892cf5-05ed-4772-a3c7-758374b46435',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=dc092d9f-c63d-420c-8856-ecb381597fd7,mac_address=fa:16:3e:c2:18:99,name='',network_id=09798d2d-0271-466c-9c29-d981c8d4721a,numa_affinity_policy=,project_id='2fcc4e24aaf24b7f8d61af98d0fd2431',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(dc092d9f-c63d-420c-8856-ecb381597fd7),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T01:02:09Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:10.211574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1ea822a7-55dd-4534-b53c-feff73605600 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (dc092d9f-c63d-420c-8856-ecb381597fd7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:10.720118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-61a9007b-7851-4ce2-82e9-f0ee83df50be admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:02:10Z,description='Default security group',id=05b837d2-50f8-4684-9dbd-f71db2b18490,is_default=True,name='default',project_id='6855896c54924c2d82431b162b1f72de',revision_number=1,rules=[SecurityGroupRule(8a40fe2d-fa69-4721-9335-a7c36964d28e),SecurityGroupRule(e7f008a3-2067-4db1-b473-0f238612fe1f),SecurityGroupRule(ec244af8-742b-4d05-a666-c6c2f550b20b),SecurityGroupRule(ffd416ca-a54c-415a-9613-945c8092189e)],shared=False,stateful=True,updated_at=2022-09-25T01:02:10Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:10.721585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-61a9007b-7851-4ce2-82e9-f0ee83df50be admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (05b837d2-50f8-4684-9dbd-f71db2b18490), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:10.721828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-61a9007b-7851-4ce2-82e9-f0ee83df50be admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:10Z,description=,direction='egress',ethertype='IPv6',id=8a40fe2d-fa69-4721-9335-a7c36964d28e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6855896c54924c2d82431b162b1f72de',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=05b837d2-50f8-4684-9dbd-f71db2b18490,updated_at=2022-09-25T01:02:10Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:10.722408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-61a9007b-7851-4ce2-82e9-f0ee83df50be admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (8a40fe2d-fa69-4721-9335-a7c36964d28e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:10.723206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-61a9007b-7851-4ce2-82e9-f0ee83df50be admin admin] Security group rule updated ['05b837d2-50f8-4684-9dbd-f71db2b18490'] Sep 25 01:02:10.724242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-61a9007b-7851-4ce2-82e9-f0ee83df50be admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:10Z,description=,direction='ingress',ethertype='IPv6',id=e7f008a3-2067-4db1-b473-0f238612fe1f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6855896c54924c2d82431b162b1f72de',protocol=,remote_address_group_id=,remote_group_id=05b837d2-50f8-4684-9dbd-f71db2b18490,remote_ip_prefix=,revision_number=0,security_group_id=05b837d2-50f8-4684-9dbd-f71db2b18490,updated_at=2022-09-25T01:02:10Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:10.725705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-61a9007b-7851-4ce2-82e9-f0ee83df50be admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (e7f008a3-2067-4db1-b473-0f238612fe1f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:10.728462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-61a9007b-7851-4ce2-82e9-f0ee83df50be admin admin] Security group rule updated ['05b837d2-50f8-4684-9dbd-f71db2b18490'] Sep 25 01:02:10.729447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-61a9007b-7851-4ce2-82e9-f0ee83df50be admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:10Z,description=,direction='egress',ethertype='IPv4',id=ec244af8-742b-4d05-a666-c6c2f550b20b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6855896c54924c2d82431b162b1f72de',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=05b837d2-50f8-4684-9dbd-f71db2b18490,updated_at=2022-09-25T01:02:10Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:10.738206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-61a9007b-7851-4ce2-82e9-f0ee83df50be admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (ec244af8-742b-4d05-a666-c6c2f550b20b), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:10.739214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-61a9007b-7851-4ce2-82e9-f0ee83df50be admin admin] Security group rule updated ['05b837d2-50f8-4684-9dbd-f71db2b18490'] Sep 25 01:02:10.740705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-61a9007b-7851-4ce2-82e9-f0ee83df50be admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:10Z,description=,direction='ingress',ethertype='IPv4',id=ffd416ca-a54c-415a-9613-945c8092189e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6855896c54924c2d82431b162b1f72de',protocol=,remote_address_group_id=,remote_group_id=05b837d2-50f8-4684-9dbd-f71db2b18490,remote_ip_prefix=,revision_number=0,security_group_id=05b837d2-50f8-4684-9dbd-f71db2b18490,updated_at=2022-09-25T01:02:10Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:10.742501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-61a9007b-7851-4ce2-82e9-f0ee83df50be admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (ffd416ca-a54c-415a-9613-945c8092189e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:10.743280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-61a9007b-7851-4ce2-82e9-f0ee83df50be admin admin] Security group rule updated ['05b837d2-50f8-4684-9dbd-f71db2b18490'] Sep 25 01:02:10.924880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e06888f7-ba19-47a9-aa3f-c75905c45bcd None None] Resource Port 41a4501b-2acb-4e3d-a37d-bedbcdc6c76d updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=41a4501b-2acb-4e3d-a37d-bedbcdc6c76d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=41a4501b-2acb-4e3d-a37d-bedbcdc6c76d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:02:10.925565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e06888f7-ba19-47a9-aa3f-c75905c45bcd None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (41a4501b-2acb-4e3d-a37d-bedbcdc6c76d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:10.930995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1ea822a7-55dd-4534-b53c-feff73605600 admin admin] Received resource Port update without any changes: dc092d9f-c63d-420c-8856-ecb381597fd7 {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 25 01:02:11.190400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-992fd9ed-de34-47c8-94f8-1dc858f1b6e2 admin admin] Resource SecurityGroup deleted: 05b837d2-50f8-4684-9dbd-f71db2b18490 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:11.190827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-992fd9ed-de34-47c8-94f8-1dc858f1b6e2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (05b837d2-50f8-4684-9dbd-f71db2b18490), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:11.191302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-992fd9ed-de34-47c8-94f8-1dc858f1b6e2 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('05b837d2-50f8-4684-9dbd-f71db2b18490',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:02:11.314425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-992fd9ed-de34-47c8-94f8-1dc858f1b6e2 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('05b837d2-50f8-4684-9dbd-f71db2b18490',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:02:11.314937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-992fd9ed-de34-47c8-94f8-1dc858f1b6e2 admin admin] Resource SecurityGroupRule deleted: 8a40fe2d-fa69-4721-9335-a7c36964d28e {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:11.315310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-992fd9ed-de34-47c8-94f8-1dc858f1b6e2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (8a40fe2d-fa69-4721-9335-a7c36964d28e), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:11.315837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-992fd9ed-de34-47c8-94f8-1dc858f1b6e2 admin admin] Security group rule updated ['05b837d2-50f8-4684-9dbd-f71db2b18490'] Sep 25 01:02:11.316418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-992fd9ed-de34-47c8-94f8-1dc858f1b6e2 admin admin] Resource SecurityGroupRule deleted: e7f008a3-2067-4db1-b473-0f238612fe1f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:11.317140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-992fd9ed-de34-47c8-94f8-1dc858f1b6e2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (e7f008a3-2067-4db1-b473-0f238612fe1f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:11.317677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-992fd9ed-de34-47c8-94f8-1dc858f1b6e2 admin admin] Security group rule updated ['05b837d2-50f8-4684-9dbd-f71db2b18490'] Sep 25 01:02:11.318461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-992fd9ed-de34-47c8-94f8-1dc858f1b6e2 admin admin] Resource SecurityGroupRule deleted: ec244af8-742b-4d05-a666-c6c2f550b20b {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:11.319311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-992fd9ed-de34-47c8-94f8-1dc858f1b6e2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (ec244af8-742b-4d05-a666-c6c2f550b20b), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:11.319949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-992fd9ed-de34-47c8-94f8-1dc858f1b6e2 admin admin] Security group rule updated ['05b837d2-50f8-4684-9dbd-f71db2b18490'] Sep 25 01:02:11.320553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-992fd9ed-de34-47c8-94f8-1dc858f1b6e2 admin admin] Resource SecurityGroupRule deleted: ffd416ca-a54c-415a-9613-945c8092189e {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:11.321135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-992fd9ed-de34-47c8-94f8-1dc858f1b6e2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (ffd416ca-a54c-415a-9613-945c8092189e), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:11.321699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-992fd9ed-de34-47c8-94f8-1dc858f1b6e2 admin admin] Security group rule updated ['05b837d2-50f8-4684-9dbd-f71db2b18490'] Sep 25 01:02:11.350291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e06888f7-ba19-47a9-aa3f-c75905c45bcd None None] Resource Port 41a4501b-2acb-4e3d-a37d-bedbcdc6c76d updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=41a4501b-2acb-4e3d-a37d-bedbcdc6c76d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=41a4501b-2acb-4e3d-a37d-bedbcdc6c76d,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=41a4501b-2acb-4e3d-a37d-bedbcdc6c76d,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:02:11.357596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e06888f7-ba19-47a9-aa3f-c75905c45bcd None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (41a4501b-2acb-4e3d-a37d-bedbcdc6c76d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:12.134365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:440 started Sep 25 01:02:12.139244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e099,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=863000000,duration_sec=894,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:12.140459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:02:12.141147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:440 - starting polling. Elapsed:0.007 Sep 25 01:02:12.146638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:12.155797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:440 - port information retrieved. Elapsed:0.021 Sep 25 01:02:12.156271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:440 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.022 Sep 25 01:02:12.306005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-973708cb-4abe-4824-a2b1-70b53644bc17 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:02:12Z,description='Default security group',id=a56a48a9-0b25-4104-a840-9e233c2e90fd,is_default=True,name='default',project_id='5a586042098641a89cceffac62777bf5',revision_number=1,rules=[SecurityGroupRule(2d457bb8-c7c6-4314-8486-4541297cda22),SecurityGroupRule(55b252af-7676-4eef-aaa6-815e4aacfdf9),SecurityGroupRule(7f357c30-3fb6-418e-8246-0c48f7d8cecc),SecurityGroupRule(d428364c-266f-454b-9832-a393e0f01648)],shared=False,stateful=True,updated_at=2022-09-25T01:02:12Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:12.306630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-973708cb-4abe-4824-a2b1-70b53644bc17 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (a56a48a9-0b25-4104-a840-9e233c2e90fd), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:12.307727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-973708cb-4abe-4824-a2b1-70b53644bc17 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:12Z,description=,direction='ingress',ethertype='IPv4',id=2d457bb8-c7c6-4314-8486-4541297cda22,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5a586042098641a89cceffac62777bf5',protocol=,remote_address_group_id=,remote_group_id=a56a48a9-0b25-4104-a840-9e233c2e90fd,remote_ip_prefix=,revision_number=0,security_group_id=a56a48a9-0b25-4104-a840-9e233c2e90fd,updated_at=2022-09-25T01:02:12Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:12.308424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-973708cb-4abe-4824-a2b1-70b53644bc17 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (2d457bb8-c7c6-4314-8486-4541297cda22), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:12.308889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-973708cb-4abe-4824-a2b1-70b53644bc17 admin admin] Security group rule updated ['a56a48a9-0b25-4104-a840-9e233c2e90fd'] Sep 25 01:02:12.310167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-973708cb-4abe-4824-a2b1-70b53644bc17 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:12Z,description=,direction='egress',ethertype='IPv4',id=55b252af-7676-4eef-aaa6-815e4aacfdf9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5a586042098641a89cceffac62777bf5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a56a48a9-0b25-4104-a840-9e233c2e90fd,updated_at=2022-09-25T01:02:12Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:12.310969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-973708cb-4abe-4824-a2b1-70b53644bc17 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (55b252af-7676-4eef-aaa6-815e4aacfdf9), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:12.311949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-973708cb-4abe-4824-a2b1-70b53644bc17 admin admin] Security group rule updated ['a56a48a9-0b25-4104-a840-9e233c2e90fd'] Sep 25 01:02:12.313226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-973708cb-4abe-4824-a2b1-70b53644bc17 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:12Z,description=,direction='egress',ethertype='IPv6',id=7f357c30-3fb6-418e-8246-0c48f7d8cecc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5a586042098641a89cceffac62777bf5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a56a48a9-0b25-4104-a840-9e233c2e90fd,updated_at=2022-09-25T01:02:12Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:12.314028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-973708cb-4abe-4824-a2b1-70b53644bc17 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (7f357c30-3fb6-418e-8246-0c48f7d8cecc), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:12.314922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-973708cb-4abe-4824-a2b1-70b53644bc17 admin admin] Security group rule updated ['a56a48a9-0b25-4104-a840-9e233c2e90fd'] Sep 25 01:02:12.316176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-973708cb-4abe-4824-a2b1-70b53644bc17 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:12Z,description=,direction='ingress',ethertype='IPv6',id=d428364c-266f-454b-9832-a393e0f01648,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5a586042098641a89cceffac62777bf5',protocol=,remote_address_group_id=,remote_group_id=a56a48a9-0b25-4104-a840-9e233c2e90fd,remote_ip_prefix=,revision_number=0,security_group_id=a56a48a9-0b25-4104-a840-9e233c2e90fd,updated_at=2022-09-25T01:02:12Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:12.316707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-973708cb-4abe-4824-a2b1-70b53644bc17 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (d428364c-266f-454b-9832-a393e0f01648), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:12.317193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-973708cb-4abe-4824-a2b1-70b53644bc17 admin admin] Security group rule updated ['a56a48a9-0b25-4104-a840-9e233c2e90fd'] Sep 25 01:02:12.582222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ddd3a3e3-b196-4591-b528-bc5dc1b6d875 admin admin] Resource SecurityGroup deleted: a56a48a9-0b25-4104-a840-9e233c2e90fd {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:12.583223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ddd3a3e3-b196-4591-b528-bc5dc1b6d875 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (a56a48a9-0b25-4104-a840-9e233c2e90fd), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:12.584213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddd3a3e3-b196-4591-b528-bc5dc1b6d875 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('a56a48a9-0b25-4104-a840-9e233c2e90fd',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:02:12.611381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ddd3a3e3-b196-4591-b528-bc5dc1b6d875 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('a56a48a9-0b25-4104-a840-9e233c2e90fd',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:02:12.612244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ddd3a3e3-b196-4591-b528-bc5dc1b6d875 admin admin] Resource SecurityGroupRule deleted: 2d457bb8-c7c6-4314-8486-4541297cda22 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:12.613070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ddd3a3e3-b196-4591-b528-bc5dc1b6d875 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (2d457bb8-c7c6-4314-8486-4541297cda22), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:12.613897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ddd3a3e3-b196-4591-b528-bc5dc1b6d875 admin admin] Security group rule updated ['a56a48a9-0b25-4104-a840-9e233c2e90fd'] Sep 25 01:02:12.614753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ddd3a3e3-b196-4591-b528-bc5dc1b6d875 admin admin] Resource SecurityGroupRule deleted: 55b252af-7676-4eef-aaa6-815e4aacfdf9 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:12.616466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ddd3a3e3-b196-4591-b528-bc5dc1b6d875 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (55b252af-7676-4eef-aaa6-815e4aacfdf9), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:12.618217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ddd3a3e3-b196-4591-b528-bc5dc1b6d875 admin admin] Security group rule updated ['a56a48a9-0b25-4104-a840-9e233c2e90fd'] Sep 25 01:02:12.619088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ddd3a3e3-b196-4591-b528-bc5dc1b6d875 admin admin] Resource SecurityGroupRule deleted: 7f357c30-3fb6-418e-8246-0c48f7d8cecc {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:12.619921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ddd3a3e3-b196-4591-b528-bc5dc1b6d875 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (7f357c30-3fb6-418e-8246-0c48f7d8cecc), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:12.620712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ddd3a3e3-b196-4591-b528-bc5dc1b6d875 admin admin] Security group rule updated ['a56a48a9-0b25-4104-a840-9e233c2e90fd'] Sep 25 01:02:12.621581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ddd3a3e3-b196-4591-b528-bc5dc1b6d875 admin admin] Resource SecurityGroupRule deleted: d428364c-266f-454b-9832-a393e0f01648 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:12.623073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ddd3a3e3-b196-4591-b528-bc5dc1b6d875 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (d428364c-266f-454b-9832-a393e0f01648), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:12.626271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ddd3a3e3-b196-4591-b528-bc5dc1b6d875 admin admin] Security group rule updated ['a56a48a9-0b25-4104-a840-9e233c2e90fd'] Sep 25 01:02:12.851705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["547f05b0-1f3e-4fd6-a256-8b960db149b4","insert","qr-dc092d9f-c6",["set",[]],["map",[["attached-mac","fa:16:3e:c2:18:99"],["iface-id","dc092d9f-c63d-420c-8856-ecb381597fd7"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:02:12.890053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["547f05b0-1f3e-4fd6-a256-8b960db149b4","old",null,["set",[]],null],["","new","qr-dc092d9f-c6",34,["map",[["attached-mac","fa:16:3e:c2:18:99"],["iface-id","dc092d9f-c63d-420c-8856-ecb381597fd7"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:02:13.453915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-87fa4b5b-0b21-41cc-986c-dadd82423c22 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:02:12Z,description='tempest-secgroup-smoke-1405492936 description',id=601e3316-8b17-4b11-acb6-e60b3d5c5c7f,is_default=False,name='tempest-secgroup-smoke-1405492936',project_id='69a3d6ce251e480d866a86ed9f6f2eb9',revision_number=1,rules=[SecurityGroupRule(8ec55e35-c309-4245-bc61-87a575ef4bee),SecurityGroupRule(f06a047f-41ad-4dc1-9a76-f0210dfd6f8d)],shared=False,stateful=True,updated_at=2022-09-25T01:02:13Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:13.455679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-87fa4b5b-0b21-41cc-986c-dadd82423c22 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (601e3316-8b17-4b11-acb6-e60b3d5c5c7f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:13.457037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-87fa4b5b-0b21-41cc-986c-dadd82423c22 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:13Z,description=,direction='egress',ethertype='IPv6',id=8ec55e35-c309-4245-bc61-87a575ef4bee,normalized_cidr=None,port_range_max=,port_range_min=,project_id='69a3d6ce251e480d866a86ed9f6f2eb9',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=601e3316-8b17-4b11-acb6-e60b3d5c5c7f,updated_at=2022-09-25T01:02:13Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:13.457932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-87fa4b5b-0b21-41cc-986c-dadd82423c22 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (8ec55e35-c309-4245-bc61-87a575ef4bee), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:13.458688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-87fa4b5b-0b21-41cc-986c-dadd82423c22 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Security group rule updated ['601e3316-8b17-4b11-acb6-e60b3d5c5c7f'] Sep 25 01:02:13.460548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-87fa4b5b-0b21-41cc-986c-dadd82423c22 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:13Z,description=,direction='egress',ethertype='IPv4',id=f06a047f-41ad-4dc1-9a76-f0210dfd6f8d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='69a3d6ce251e480d866a86ed9f6f2eb9',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=601e3316-8b17-4b11-acb6-e60b3d5c5c7f,updated_at=2022-09-25T01:02:13Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:13.461640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-87fa4b5b-0b21-41cc-986c-dadd82423c22 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f06a047f-41ad-4dc1-9a76-f0210dfd6f8d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:13.462620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-87fa4b5b-0b21-41cc-986c-dadd82423c22 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Security group rule updated ['601e3316-8b17-4b11-acb6-e60b3d5c5c7f'] Sep 25 01:02:13.717731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["164661bd-0078-407f-875a-fdcca48ddfa8","insert","qg-41a4501b-2a",["set",[]],["map",[["attached-mac","fa:16:3e:9d:76:4c"],["iface-id","41a4501b-2acb-4e3d-a37d-bedbcdc6c76d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:02:13.726762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2cda17f5-33dd-4210-afc3-abbffc9c2c7d tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:13Z,description='',direction='ingress',ethertype='IPv4',id=211f64c3-c314-4c9f-b3d1-ff23656dd576,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='69a3d6ce251e480d866a86ed9f6f2eb9',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=601e3316-8b17-4b11-acb6-e60b3d5c5c7f,updated_at=2022-09-25T01:02:13Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:13.726762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2cda17f5-33dd-4210-afc3-abbffc9c2c7d tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (211f64c3-c314-4c9f-b3d1-ff23656dd576), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:13.727204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2cda17f5-33dd-4210-afc3-abbffc9c2c7d tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Security group rule updated ['601e3316-8b17-4b11-acb6-e60b3d5c5c7f'] Sep 25 01:02:13.752262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["164661bd-0078-407f-875a-fdcca48ddfa8","old",null,["set",[]],null],["","new","qg-41a4501b-2a",35,["map",[["attached-mac","fa:16:3e:9d:76:4c"],["iface-id","41a4501b-2acb-4e3d-a37d-bedbcdc6c76d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:02:14.062753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-38361d17-fe62-4a66-abb5-c4218df1b537 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:13Z,description='',direction='egress',ethertype='IPv4',id=ef795a18-98c0-4f10-9132-78c71f273f10,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='69a3d6ce251e480d866a86ed9f6f2eb9',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=601e3316-8b17-4b11-acb6-e60b3d5c5c7f,updated_at=2022-09-25T01:02:13Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:14.063154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-38361d17-fe62-4a66-abb5-c4218df1b537 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (ef795a18-98c0-4f10-9132-78c71f273f10), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:14.063509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-38361d17-fe62-4a66-abb5-c4218df1b537 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Security group rule updated ['601e3316-8b17-4b11-acb6-e60b3d5c5c7f'] Sep 25 01:02:14.137803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:441 started Sep 25 01:02:14.144760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e09b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=866000000,duration_sec=896,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:14.145867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:02:14.146508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:441 - starting polling. Elapsed:0.009 Sep 25 01:02:14.153929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:14.159593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:441 - port information retrieved. Elapsed:0.022 Sep 25 01:02:14.159986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', '41a4501b-2acb-4e3d-a37d-bedbcdc6c76d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'd18a3c48-8be7-45c0-8641-dd3182b273bc', 'dc092d9f-c63d-420c-8856-ecb381597fd7', '312a0875-9d08-4c94-b6f3-3135500afa6a', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '71ee88f3-d4ca-4676-ab1f-7494784204fa', '4a688d1f-1335-463f-b319-bcba153c442f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'de4727a2-569d-44c6-a53e-ecc89817f610', 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92'}, 'added': {'41a4501b-2acb-4e3d-a37d-bedbcdc6c76d', 'dc092d9f-c63d-420c-8856-ecb381597fd7'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:02:14.160599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '41a4501b-2acb-4e3d-a37d-bedbcdc6c76d', 'device_id': '29892cf5-05ed-4772-a3c7-758374b46435', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': '41a4501b-2acb-4e3d-a37d-bedbcdc6c76d', 'mac_address': 'fa:16:3e:9d:76:4c', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.130'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 01:02:14.161210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: WARNING neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:02:09Z,data_plane_status=None,description='',device_id='29892cf5-05ed-4772-a3c7-758374b46435',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=dc092d9f-c63d-420c-8856-ecb381597fd7,mac_address=fa:16:3e:c2:18:99,name='',network_id=09798d2d-0271-466c-9c29-d981c8d4721a,numa_affinity_policy=,project_id='2fcc4e24aaf24b7f8d61af98d0fd2431',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(dc092d9f-c63d-420c-8856-ecb381597fd7),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T01:02:10Z) is not bound. Sep 25 01:02:14.182051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 41a4501b-2acb-4e3d-a37d-bedbcdc6c76d {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 01:02:14.182709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 41a4501b-2acb-4e3d-a37d-bedbcdc6c76d updated. Details: {'device': '41a4501b-2acb-4e3d-a37d-bedbcdc6c76d', 'device_id': '29892cf5-05ed-4772-a3c7-758374b46435', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': '41a4501b-2acb-4e3d-a37d-bedbcdc6c76d', 'mac_address': 'fa:16:3e:9d:76:4c', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.130'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 25 01:02:14.184082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-41a4501b-2a, col_values=(('tag', 2),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:02:14.184712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-41a4501b-2a, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:02:14.185357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-41a4501b-2a, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:02:14.198940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-41a4501b-2a, col_values=(('other_config', {'net_uuid': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:02:14.232511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e09d,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 35}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:14.240093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: dc092d9f-c63d-420c-8856-ecb381597fd7 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 01:02:14.240093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Device dc092d9f-c63d-420c-8856-ecb381597fd7 not defined on plugin or binding failed Sep 25 01:02:14.249611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:441 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 22 devices currently available. Time elapsed: 0.080 Sep 25 01:02:14.250069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing device filters for 2 new devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 25 01:02:14.250384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing filters for devices {'41a4501b-2acb-4e3d-a37d-bedbcdc6c76d', 'dc092d9f-c63d-420c-8856-ecb381597fd7'} Sep 25 01:02:14.254440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 01:02:14.254738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 01:02:14.267639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:02:14.344934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d714c313-7aab-4b21-bdf4-695a0bfb9ea3]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:02:14.345716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:441 - agent port security group processed in 0.185 Sep 25 01:02:14.346686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 41a4501b-2acb-4e3d-a37d-bedbcdc6c76d to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 01:02:14.373585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-40698478-1bfb-4acf-af34-9249749b78b4 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:14Z,description='',direction='ingress',ethertype='IPv4',id=e6a4126b-f632-4bb4-b7d0-4dd4dd6eac9f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='69a3d6ce251e480d866a86ed9f6f2eb9',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=601e3316-8b17-4b11-acb6-e60b3d5c5c7f,updated_at=2022-09-25T01:02:14Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:14.374511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-40698478-1bfb-4acf-af34-9249749b78b4 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (e6a4126b-f632-4bb4-b7d0-4dd4dd6eac9f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:14.375105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-40698478-1bfb-4acf-af34-9249749b78b4 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Security group rule updated ['601e3316-8b17-4b11-acb6-e60b3d5c5c7f'] Sep 25 01:02:14.658460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-15f41afd-bff2-4770-baec-06f169c1aab9 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:14Z,description='',direction='egress',ethertype='IPv4',id=ebac5701-43d3-4e9c-a318-3da173aa3042,normalized_cidr=None,port_range_max=,port_range_min=,project_id='69a3d6ce251e480d866a86ed9f6f2eb9',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=601e3316-8b17-4b11-acb6-e60b3d5c5c7f,updated_at=2022-09-25T01:02:14Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:14.659155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-15f41afd-bff2-4770-baec-06f169c1aab9 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (ebac5701-43d3-4e9c-a318-3da173aa3042), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:14.659907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-15f41afd-bff2-4770-baec-06f169c1aab9 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Security group rule updated ['601e3316-8b17-4b11-acb6-e60b3d5c5c7f'] Sep 25 01:02:14.740332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['41a4501b-2acb-4e3d-a37d-bedbcdc6c76d'] and devices down [] completed. Sep 25 01:02:14.740961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:441 - ports processed. Elapsed:0.603 Sep 25 01:02:14.741506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:441 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 0, 'removed': 0}}. Elapsed:0.604 Sep 25 01:02:14.873565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Resource Port 41a4501b-2acb-4e3d-a37d-bedbcdc6c76d updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=41a4501b-2acb-4e3d-a37d-bedbcdc6c76d,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=41a4501b-2acb-4e3d-a37d-bedbcdc6c76d,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)], 'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:02:14.873565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (41a4501b-2acb-4e3d-a37d-bedbcdc6c76d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:14.973786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-89aea522-8590-401c-9e58-6db143f92a77 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:14Z,description='',direction='ingress',ethertype='IPv6',id=68c09630-d5d2-43de-89c8-8d02767bece3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='69a3d6ce251e480d866a86ed9f6f2eb9',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=601e3316-8b17-4b11-acb6-e60b3d5c5c7f,updated_at=2022-09-25T01:02:14Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:14.974739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-89aea522-8590-401c-9e58-6db143f92a77 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (68c09630-d5d2-43de-89c8-8d02767bece3), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:14.975344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-89aea522-8590-401c-9e58-6db143f92a77 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Security group rule updated ['601e3316-8b17-4b11-acb6-e60b3d5c5c7f'] Sep 25 01:02:15.208072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5e6217a3-23db-40b9-ad15-ef8e7293160e tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:15Z,description='',direction='egress',ethertype='IPv6',id=f4bbc97f-b8d5-4e40-acbc-615bbc4feee5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='69a3d6ce251e480d866a86ed9f6f2eb9',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=601e3316-8b17-4b11-acb6-e60b3d5c5c7f,updated_at=2022-09-25T01:02:15Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:15.208601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5e6217a3-23db-40b9-ad15-ef8e7293160e tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f4bbc97f-b8d5-4e40-acbc-615bbc4feee5), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:15.208910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5e6217a3-23db-40b9-ad15-ef8e7293160e tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Security group rule updated ['601e3316-8b17-4b11-acb6-e60b3d5c5c7f'] Sep 25 01:02:16.139505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:442 started Sep 25 01:02:16.143771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e09f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=868000000,duration_sec=898,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:16.144724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:02:16.145319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:442 - starting polling. Elapsed:0.006 Sep 25 01:02:16.151856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:16.161957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:442 - port information retrieved. Elapsed:0.023 Sep 25 01:02:16.162764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', '41a4501b-2acb-4e3d-a37d-bedbcdc6c76d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'd18a3c48-8be7-45c0-8641-dd3182b273bc', 'dc092d9f-c63d-420c-8856-ecb381597fd7', '312a0875-9d08-4c94-b6f3-3135500afa6a', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '71ee88f3-d4ca-4676-ab1f-7494784204fa', '4a688d1f-1335-463f-b319-bcba153c442f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'de4727a2-569d-44c6-a53e-ecc89817f610', 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92'}, 'added': set(), 'removed': set(), 'updated': {'41a4501b-2acb-4e3d-a37d-bedbcdc6c76d'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:02:16.165247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '41a4501b-2acb-4e3d-a37d-bedbcdc6c76d', 'device_id': '29892cf5-05ed-4772-a3c7-758374b46435', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': '41a4501b-2acb-4e3d-a37d-bedbcdc6c76d', 'mac_address': 'fa:16:3e:9d:76:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.130'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 01:02:16.175136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 41a4501b-2acb-4e3d-a37d-bedbcdc6c76d {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 01:02:16.175751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 41a4501b-2acb-4e3d-a37d-bedbcdc6c76d updated. Details: {'device': '41a4501b-2acb-4e3d-a37d-bedbcdc6c76d', 'device_id': '29892cf5-05ed-4772-a3c7-758374b46435', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': '41a4501b-2acb-4e3d-a37d-bedbcdc6c76d', 'mac_address': 'fa:16:3e:9d:76:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.130'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 25 01:02:16.177562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-41a4501b-2a, col_values=(('tag', 2),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:02:16.178574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-41a4501b-2a, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:02:16.179563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-41a4501b-2a, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:02:16.180329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 01:02:16.181941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-41a4501b-2a, col_values=(('other_config', {'net_uuid': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:02:16.183398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 01:02:16.191036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e0a1,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 35}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:16.192032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:442 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 22 devices currently available. Time elapsed: 0.028 Sep 25 01:02:16.192881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refreshing firewall for 1 devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 25 01:02:16.193664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refresh firewall rules Sep 25 01:02:16.197973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 01:02:16.198720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 01:02:16.213178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:02:16.283355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[512230d3-16db-4b68-bb36-6c160a25ea12]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:02:16.286060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:442 - agent port security group processed in 0.122 Sep 25 01:02:16.287510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 41a4501b-2acb-4e3d-a37d-bedbcdc6c76d to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 01:02:16.548631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['41a4501b-2acb-4e3d-a37d-bedbcdc6c76d'] and devices down [] completed. Sep 25 01:02:16.549704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:442 - ports processed. Elapsed:0.410 Sep 25 01:02:16.550355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:442 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.411 Sep 25 01:02:17.899464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fa90edb6-d32a-4ade-9d2c-ea662a69414c None None] Resource Port dc092d9f-c63d-420c-8856-ecb381597fd7 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=dc092d9f-c63d-420c-8856-ecb381597fd7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=dc092d9f-c63d-420c-8856-ecb381597fd7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:02:17.901054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fa90edb6-d32a-4ade-9d2c-ea662a69414c None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (dc092d9f-c63d-420c-8856-ecb381597fd7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:18.140838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:443 started Sep 25 01:02:18.157909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0a3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=870000000,duration_sec=900,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:18.159130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:02:18.161639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:443 - starting polling. Elapsed:0.021 Sep 25 01:02:18.171969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:18.177356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:443 - port information retrieved. Elapsed:0.037 Sep 25 01:02:18.179262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', '41a4501b-2acb-4e3d-a37d-bedbcdc6c76d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'd18a3c48-8be7-45c0-8641-dd3182b273bc', 'dc092d9f-c63d-420c-8856-ecb381597fd7', '312a0875-9d08-4c94-b6f3-3135500afa6a', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '71ee88f3-d4ca-4676-ab1f-7494784204fa', '4a688d1f-1335-463f-b319-bcba153c442f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'de4727a2-569d-44c6-a53e-ecc89817f610', 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92'}, 'added': set(), 'removed': set(), 'updated': {'dc092d9f-c63d-420c-8856-ecb381597fd7'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:02:18.179966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: WARNING neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:02:09Z,data_plane_status=None,description='',device_id='29892cf5-05ed-4772-a3c7-758374b46435',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=dc092d9f-c63d-420c-8856-ecb381597fd7,mac_address=fa:16:3e:c2:18:99,name='',network_id=09798d2d-0271-466c-9c29-d981c8d4721a,numa_affinity_policy=,project_id='2fcc4e24aaf24b7f8d61af98d0fd2431',qos_network_policy_id=None,qos_policy_id=None,revision_number=3,security=PortSecurity(dc092d9f-c63d-420c-8856-ecb381597fd7),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T01:02:17Z) is not bound. Sep 25 01:02:18.186027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: dc092d9f-c63d-420c-8856-ecb381597fd7 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 01:02:18.186027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Device dc092d9f-c63d-420c-8856-ecb381597fd7 not defined on plugin or binding failed Sep 25 01:02:18.186027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:443 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 22 devices currently available. Time elapsed: 0.006 Sep 25 01:02:18.187517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refreshing firewall for 1 devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 25 01:02:18.187517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refresh firewall rules Sep 25 01:02:18.189814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 01:02:18.189814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 01:02:18.202836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:443 - agent port security group processed in 0.023 Sep 25 01:02:18.206770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up [] and devices down [] completed. Sep 25 01:02:18.207172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:443 - ports processed. Elapsed:0.066 Sep 25 01:02:18.207889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:443 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.067 Sep 25 01:02:18.313665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fa90edb6-d32a-4ade-9d2c-ea662a69414c None None] Resource Port dc092d9f-c63d-420c-8856-ecb381597fd7 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=dc092d9f-c63d-420c-8856-ecb381597fd7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=dc092d9f-c63d-420c-8856-ecb381597fd7,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=dc092d9f-c63d-420c-8856-ecb381597fd7,segment=NetworkSegment(1a5d6abd-d257-4ac1-9e42-36c802984848),segment_id=1a5d6abd-d257-4ac1-9e42-36c802984848)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:02:18.315104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fa90edb6-d32a-4ade-9d2c-ea662a69414c None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (dc092d9f-c63d-420c-8856-ecb381597fd7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:18.913558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-128b72fb-25c4-4c4c-8236-a4fc450456ea None None] Resource Port dc092d9f-c63d-420c-8856-ecb381597fd7 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:02:18.914540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-128b72fb-25c4-4c4c-8236-a4fc450456ea None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (dc092d9f-c63d-420c-8856-ecb381597fd7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:20.143616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:444 started Sep 25 01:02:20.158849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0a5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=872000000,duration_sec=902,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:20.160128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:02:20.161188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:444 - starting polling. Elapsed:0.018 Sep 25 01:02:20.173763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:20.178857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:444 - port information retrieved. Elapsed:0.036 Sep 25 01:02:20.179425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', '41a4501b-2acb-4e3d-a37d-bedbcdc6c76d', 'a62d43a0-f84e-4f0c-bde1-8e3aa339843e', '8a22f42d-c327-4ae1-9e34-d8947d30272d', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'd18a3c48-8be7-45c0-8641-dd3182b273bc', 'dc092d9f-c63d-420c-8856-ecb381597fd7', '312a0875-9d08-4c94-b6f3-3135500afa6a', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '71ee88f3-d4ca-4676-ab1f-7494784204fa', '4a688d1f-1335-463f-b319-bcba153c442f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'de4727a2-569d-44c6-a53e-ecc89817f610', 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92'}, 'added': set(), 'removed': set(), 'updated': {'dc092d9f-c63d-420c-8856-ecb381597fd7'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:02:20.180283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': 'dc092d9f-c63d-420c-8856-ecb381597fd7', 'device_id': '29892cf5-05ed-4772-a3c7-758374b46435', 'network_id': '09798d2d-0271-466c-9c29-d981c8d4721a', 'port_id': 'dc092d9f-c63d-420c-8856-ecb381597fd7', 'mac_address': 'fa:16:3e:c2:18:99', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 70, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '8411f93b-86a3-4016-8215-1e4f10f0027b', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 01:02:20.186645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: dc092d9f-c63d-420c-8856-ecb381597fd7 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 01:02:20.187278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port dc092d9f-c63d-420c-8856-ecb381597fd7 updated. Details: {'device': 'dc092d9f-c63d-420c-8856-ecb381597fd7', 'device_id': '29892cf5-05ed-4772-a3c7-758374b46435', 'network_id': '09798d2d-0271-466c-9c29-d981c8d4721a', 'port_id': 'dc092d9f-c63d-420c-8856-ecb381597fd7', 'mac_address': 'fa:16:3e:c2:18:99', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 70, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '8411f93b-86a3-4016-8215-1e4f10f0027b', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 13} Sep 25 01:02:20.188723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-dc092d9f-c6, col_values=(('tag', 13),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:02:20.189704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-dc092d9f-c6, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:02:20.191237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-dc092d9f-c6, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:02:20.213643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-dc092d9f-c6, col_values=(('other_config', {'net_uuid': '09798d2d-0271-466c-9c29-d981c8d4721a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '13', 'segmentation_id': '70'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:02:20.239943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e0a7,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 34}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:20.240167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:444 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 22 devices currently available. Time elapsed: 0.060 Sep 25 01:02:20.245086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refreshing firewall for 1 devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 25 01:02:20.245688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refresh firewall rules Sep 25 01:02:20.247883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 01:02:20.250425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 01:02:20.277913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:02:20.297040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 4aef1009-d2d3-4c6f-af8a-c5134e19fa37 updated (revision_number 7->8). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'DOWN'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:02:20.297472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (4aef1009-d2d3-4c6f-af8a-c5134e19fa37), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:20.391365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c361dd4c-1273-42e0-8d96-4c2cc53fbad2]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:02:20.393867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:444 - agent port security group processed in 0.213 Sep 25 01:02:20.396450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for dc092d9f-c63d-420c-8856-ecb381597fd7 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 01:02:20.578423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['dc092d9f-c63d-420c-8856-ecb381597fd7'] and devices down [] completed. Sep 25 01:02:20.578632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:444 - ports processed. Elapsed:0.436 Sep 25 01:02:20.578992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:444 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.436 Sep 25 01:02:22.144441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:445 started Sep 25 01:02:22.153098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0a9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=875000000,duration_sec=904,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:22.154563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:02:22.155115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:445 - starting polling. Elapsed:0.011 Sep 25 01:02:22.161838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:22.170534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:445 - port information retrieved. Elapsed:0.026 Sep 25 01:02:22.171081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:445 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.027 Sep 25 01:02:24.149028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:446 started Sep 25 01:02:24.154889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0ab,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=880000000,duration_sec=906,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:24.155684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:02:24.157584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:446 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 25 01:02:26.149245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:447 started Sep 25 01:02:26.153010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0ad,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=878000000,duration_sec=908,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:26.154008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:02:26.154619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:447 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:02:28.150322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:448 started Sep 25 01:02:28.190774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0af,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=880000000,duration_sec=910,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:28.215352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:02:28.216256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:448 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.067 Sep 25 01:02:28.221612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-20316fd8-d0f5-4ffd-8d9e-edaecbaf554a admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:02:27Z,description='Default security group',id=53036964-0b6a-459f-aa07-d4182bb04db0,is_default=True,name='default',project_id='21d8d89a1819407984ff0b3b4d02fec1',revision_number=1,rules=[SecurityGroupRule(4085fdd4-e0b1-4a66-b6ff-0e21b8cbf67e),SecurityGroupRule(af715a4a-75b6-46de-964b-f4bc0d1e4de4),SecurityGroupRule(bbc90f55-891e-4266-a8a9-41b19bde8ff9),SecurityGroupRule(c1a12cc4-2814-4452-878c-a70e118633c5)],shared=False,stateful=True,updated_at=2022-09-25T01:02:27Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:28.222655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-20316fd8-d0f5-4ffd-8d9e-edaecbaf554a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (53036964-0b6a-459f-aa07-d4182bb04db0), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:28.224106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-20316fd8-d0f5-4ffd-8d9e-edaecbaf554a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:27Z,description=,direction='ingress',ethertype='IPv6',id=4085fdd4-e0b1-4a66-b6ff-0e21b8cbf67e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='21d8d89a1819407984ff0b3b4d02fec1',protocol=,remote_address_group_id=,remote_group_id=53036964-0b6a-459f-aa07-d4182bb04db0,remote_ip_prefix=,revision_number=0,security_group_id=53036964-0b6a-459f-aa07-d4182bb04db0,updated_at=2022-09-25T01:02:27Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:28.225694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-20316fd8-d0f5-4ffd-8d9e-edaecbaf554a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (4085fdd4-e0b1-4a66-b6ff-0e21b8cbf67e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:28.227484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-20316fd8-d0f5-4ffd-8d9e-edaecbaf554a admin admin] Security group rule updated ['53036964-0b6a-459f-aa07-d4182bb04db0'] Sep 25 01:02:28.229123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-20316fd8-d0f5-4ffd-8d9e-edaecbaf554a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:27Z,description=,direction='egress',ethertype='IPv6',id=af715a4a-75b6-46de-964b-f4bc0d1e4de4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='21d8d89a1819407984ff0b3b4d02fec1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=53036964-0b6a-459f-aa07-d4182bb04db0,updated_at=2022-09-25T01:02:27Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:28.230091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-20316fd8-d0f5-4ffd-8d9e-edaecbaf554a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (af715a4a-75b6-46de-964b-f4bc0d1e4de4), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:28.230968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-20316fd8-d0f5-4ffd-8d9e-edaecbaf554a admin admin] Security group rule updated ['53036964-0b6a-459f-aa07-d4182bb04db0'] Sep 25 01:02:28.232823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-20316fd8-d0f5-4ffd-8d9e-edaecbaf554a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:27Z,description=,direction='ingress',ethertype='IPv4',id=bbc90f55-891e-4266-a8a9-41b19bde8ff9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='21d8d89a1819407984ff0b3b4d02fec1',protocol=,remote_address_group_id=,remote_group_id=53036964-0b6a-459f-aa07-d4182bb04db0,remote_ip_prefix=,revision_number=0,security_group_id=53036964-0b6a-459f-aa07-d4182bb04db0,updated_at=2022-09-25T01:02:27Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:28.233749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-20316fd8-d0f5-4ffd-8d9e-edaecbaf554a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (bbc90f55-891e-4266-a8a9-41b19bde8ff9), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:28.234998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-20316fd8-d0f5-4ffd-8d9e-edaecbaf554a admin admin] Security group rule updated ['53036964-0b6a-459f-aa07-d4182bb04db0'] Sep 25 01:02:28.236569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-20316fd8-d0f5-4ffd-8d9e-edaecbaf554a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:27Z,description=,direction='egress',ethertype='IPv4',id=c1a12cc4-2814-4452-878c-a70e118633c5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='21d8d89a1819407984ff0b3b4d02fec1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=53036964-0b6a-459f-aa07-d4182bb04db0,updated_at=2022-09-25T01:02:27Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:28.237573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-20316fd8-d0f5-4ffd-8d9e-edaecbaf554a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (c1a12cc4-2814-4452-878c-a70e118633c5), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:28.238459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-20316fd8-d0f5-4ffd-8d9e-edaecbaf554a admin admin] Security group rule updated ['53036964-0b6a-459f-aa07-d4182bb04db0'] Sep 25 01:02:28.654220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-66945f0b-a040-427c-bc23-e07beaf5564f admin admin] Resource SecurityGroup deleted: 53036964-0b6a-459f-aa07-d4182bb04db0 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:28.655079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-66945f0b-a040-427c-bc23-e07beaf5564f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (53036964-0b6a-459f-aa07-d4182bb04db0), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:28.655819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66945f0b-a040-427c-bc23-e07beaf5564f admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('53036964-0b6a-459f-aa07-d4182bb04db0',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:02:28.696119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-66945f0b-a040-427c-bc23-e07beaf5564f admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('53036964-0b6a-459f-aa07-d4182bb04db0',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:02:28.697072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-66945f0b-a040-427c-bc23-e07beaf5564f admin admin] Resource SecurityGroupRule deleted: 4085fdd4-e0b1-4a66-b6ff-0e21b8cbf67e {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:28.697929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-66945f0b-a040-427c-bc23-e07beaf5564f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (4085fdd4-e0b1-4a66-b6ff-0e21b8cbf67e), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:28.698506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-66945f0b-a040-427c-bc23-e07beaf5564f admin admin] Security group rule updated ['53036964-0b6a-459f-aa07-d4182bb04db0'] Sep 25 01:02:28.699154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-66945f0b-a040-427c-bc23-e07beaf5564f admin admin] Resource SecurityGroupRule deleted: af715a4a-75b6-46de-964b-f4bc0d1e4de4 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:28.699747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-66945f0b-a040-427c-bc23-e07beaf5564f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (af715a4a-75b6-46de-964b-f4bc0d1e4de4), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:28.700287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-66945f0b-a040-427c-bc23-e07beaf5564f admin admin] Security group rule updated ['53036964-0b6a-459f-aa07-d4182bb04db0'] Sep 25 01:02:28.700937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-66945f0b-a040-427c-bc23-e07beaf5564f admin admin] Resource SecurityGroupRule deleted: bbc90f55-891e-4266-a8a9-41b19bde8ff9 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:28.701573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-66945f0b-a040-427c-bc23-e07beaf5564f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (bbc90f55-891e-4266-a8a9-41b19bde8ff9), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:28.702120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-66945f0b-a040-427c-bc23-e07beaf5564f admin admin] Security group rule updated ['53036964-0b6a-459f-aa07-d4182bb04db0'] Sep 25 01:02:28.702747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-66945f0b-a040-427c-bc23-e07beaf5564f admin admin] Resource SecurityGroupRule deleted: c1a12cc4-2814-4452-878c-a70e118633c5 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:28.704159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-66945f0b-a040-427c-bc23-e07beaf5564f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (c1a12cc4-2814-4452-878c-a70e118633c5), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:28.704935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-66945f0b-a040-427c-bc23-e07beaf5564f admin admin] Security group rule updated ['53036964-0b6a-459f-aa07-d4182bb04db0'] Sep 25 01:02:29.382875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5aac84e1-45f7-42c2-88fc-a42ccde76b78 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:02:29Z,description='Default security group',id=1cc94378-28e8-43f6-b1d4-11f5cacfa440,is_default=True,name='default',project_id='f5f655cf4e484f9583745ccc3a63ded5',revision_number=1,rules=[SecurityGroupRule(1133a219-186f-4c3e-b9d4-d62a923dd277),SecurityGroupRule(3446f848-66e6-4d38-8bb1-dc7cbf35eec3),SecurityGroupRule(3e9090dc-12be-4cbc-abc6-ca14025f4704),SecurityGroupRule(d9a4b55a-d892-4883-ba7c-77d70ba88cf0)],shared=False,stateful=True,updated_at=2022-09-25T01:02:29Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:29.384080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5aac84e1-45f7-42c2-88fc-a42ccde76b78 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (1cc94378-28e8-43f6-b1d4-11f5cacfa440), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:29.384335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5aac84e1-45f7-42c2-88fc-a42ccde76b78 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:29Z,description=,direction='egress',ethertype='IPv4',id=1133a219-186f-4c3e-b9d4-d62a923dd277,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f5f655cf4e484f9583745ccc3a63ded5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1cc94378-28e8-43f6-b1d4-11f5cacfa440,updated_at=2022-09-25T01:02:29Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:29.384813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5aac84e1-45f7-42c2-88fc-a42ccde76b78 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (1133a219-186f-4c3e-b9d4-d62a923dd277), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:29.385238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5aac84e1-45f7-42c2-88fc-a42ccde76b78 admin admin] Security group rule updated ['1cc94378-28e8-43f6-b1d4-11f5cacfa440'] Sep 25 01:02:29.386035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5aac84e1-45f7-42c2-88fc-a42ccde76b78 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:29Z,description=,direction='ingress',ethertype='IPv6',id=3446f848-66e6-4d38-8bb1-dc7cbf35eec3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f5f655cf4e484f9583745ccc3a63ded5',protocol=,remote_address_group_id=,remote_group_id=1cc94378-28e8-43f6-b1d4-11f5cacfa440,remote_ip_prefix=,revision_number=0,security_group_id=1cc94378-28e8-43f6-b1d4-11f5cacfa440,updated_at=2022-09-25T01:02:29Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:29.386709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5aac84e1-45f7-42c2-88fc-a42ccde76b78 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (3446f848-66e6-4d38-8bb1-dc7cbf35eec3), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:29.387603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5aac84e1-45f7-42c2-88fc-a42ccde76b78 admin admin] Security group rule updated ['1cc94378-28e8-43f6-b1d4-11f5cacfa440'] Sep 25 01:02:29.388751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5aac84e1-45f7-42c2-88fc-a42ccde76b78 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:29Z,description=,direction='ingress',ethertype='IPv4',id=3e9090dc-12be-4cbc-abc6-ca14025f4704,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f5f655cf4e484f9583745ccc3a63ded5',protocol=,remote_address_group_id=,remote_group_id=1cc94378-28e8-43f6-b1d4-11f5cacfa440,remote_ip_prefix=,revision_number=0,security_group_id=1cc94378-28e8-43f6-b1d4-11f5cacfa440,updated_at=2022-09-25T01:02:29Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:29.390009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5aac84e1-45f7-42c2-88fc-a42ccde76b78 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (3e9090dc-12be-4cbc-abc6-ca14025f4704), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:29.390751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5aac84e1-45f7-42c2-88fc-a42ccde76b78 admin admin] Security group rule updated ['1cc94378-28e8-43f6-b1d4-11f5cacfa440'] Sep 25 01:02:29.399300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5aac84e1-45f7-42c2-88fc-a42ccde76b78 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:29Z,description=,direction='egress',ethertype='IPv6',id=d9a4b55a-d892-4883-ba7c-77d70ba88cf0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f5f655cf4e484f9583745ccc3a63ded5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1cc94378-28e8-43f6-b1d4-11f5cacfa440,updated_at=2022-09-25T01:02:29Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:29.399810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5aac84e1-45f7-42c2-88fc-a42ccde76b78 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (d9a4b55a-d892-4883-ba7c-77d70ba88cf0), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:29.400159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5aac84e1-45f7-42c2-88fc-a42ccde76b78 admin admin] Security group rule updated ['1cc94378-28e8-43f6-b1d4-11f5cacfa440'] Sep 25 01:02:29.654653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8696fbec-073b-4758-9d4e-ae1da06b65a2 admin admin] Resource SecurityGroup deleted: 1cc94378-28e8-43f6-b1d4-11f5cacfa440 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:29.655721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8696fbec-073b-4758-9d4e-ae1da06b65a2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (1cc94378-28e8-43f6-b1d4-11f5cacfa440), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:29.656583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8696fbec-073b-4758-9d4e-ae1da06b65a2 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('1cc94378-28e8-43f6-b1d4-11f5cacfa440',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:02:29.673319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8696fbec-073b-4758-9d4e-ae1da06b65a2 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('1cc94378-28e8-43f6-b1d4-11f5cacfa440',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:02:29.674422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8696fbec-073b-4758-9d4e-ae1da06b65a2 admin admin] Resource SecurityGroupRule deleted: 1133a219-186f-4c3e-b9d4-d62a923dd277 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:29.675225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8696fbec-073b-4758-9d4e-ae1da06b65a2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (1133a219-186f-4c3e-b9d4-d62a923dd277), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:29.675840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8696fbec-073b-4758-9d4e-ae1da06b65a2 admin admin] Security group rule updated ['1cc94378-28e8-43f6-b1d4-11f5cacfa440'] Sep 25 01:02:29.676531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8696fbec-073b-4758-9d4e-ae1da06b65a2 admin admin] Resource SecurityGroupRule deleted: 3446f848-66e6-4d38-8bb1-dc7cbf35eec3 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:29.677164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8696fbec-073b-4758-9d4e-ae1da06b65a2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (3446f848-66e6-4d38-8bb1-dc7cbf35eec3), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:29.677760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8696fbec-073b-4758-9d4e-ae1da06b65a2 admin admin] Security group rule updated ['1cc94378-28e8-43f6-b1d4-11f5cacfa440'] Sep 25 01:02:29.678436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8696fbec-073b-4758-9d4e-ae1da06b65a2 admin admin] Resource SecurityGroupRule deleted: 3e9090dc-12be-4cbc-abc6-ca14025f4704 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:29.679014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8696fbec-073b-4758-9d4e-ae1da06b65a2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (3e9090dc-12be-4cbc-abc6-ca14025f4704), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:29.679596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8696fbec-073b-4758-9d4e-ae1da06b65a2 admin admin] Security group rule updated ['1cc94378-28e8-43f6-b1d4-11f5cacfa440'] Sep 25 01:02:29.680559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8696fbec-073b-4758-9d4e-ae1da06b65a2 admin admin] Resource SecurityGroupRule deleted: d9a4b55a-d892-4883-ba7c-77d70ba88cf0 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:29.681445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8696fbec-073b-4758-9d4e-ae1da06b65a2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (d9a4b55a-d892-4883-ba7c-77d70ba88cf0), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:29.682221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8696fbec-073b-4758-9d4e-ae1da06b65a2 admin admin] Security group rule updated ['1cc94378-28e8-43f6-b1d4-11f5cacfa440'] Sep 25 01:02:30.158131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:449 started Sep 25 01:02:30.166437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0b1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=889000000,duration_sec=912,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:30.167588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:02:30.168156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:449 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Sep 25 01:02:32.152939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:450 started Sep 25 01:02:32.156105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0b3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=881000000,duration_sec=914,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:32.156807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:02:32.157172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:450 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:02:34.153663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:451 started Sep 25 01:02:34.156902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0b5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=883000000,duration_sec=916,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:34.157598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:02:34.158087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:451 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:02:36.154953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:452 started Sep 25 01:02:36.158244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0b7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=883000000,duration_sec=918,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:36.158902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:02:36.159395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:452 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:02:37.964027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 4aef1009-d2d3-4c6f-af8a-c5134e19fa37 updated (revision_number 8->9). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:02:37.964897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (4aef1009-d2d3-4c6f-af8a-c5134e19fa37), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:38.155752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:453 started Sep 25 01:02:38.158523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0b9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=884000000,duration_sec=920,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:38.159138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:02:38.159479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:453 - starting polling. Elapsed:0.004 Sep 25 01:02:38.163990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:38.168268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:453 - port information retrieved. Elapsed:0.013 Sep 25 01:02:38.168618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:453 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 25 01:02:40.156982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:454 started Sep 25 01:02:40.161166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0bb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=886000000,duration_sec=922,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:40.162682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:02:40.163287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:454 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:02:41.867086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 4aef1009-d2d3-4c6f-af8a-c5134e19fa37 updated (revision_number 9->10). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:02:41.867824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (4aef1009-d2d3-4c6f-af8a-c5134e19fa37), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:42.158624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:455 started Sep 25 01:02:42.164344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0bd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=888000000,duration_sec=924,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:42.165116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:02:42.165583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:455 - starting polling. Elapsed:0.007 Sep 25 01:02:42.169298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:42.179478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:455 - port information retrieved. Elapsed:0.021 Sep 25 01:02:42.180136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:455 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.022 Sep 25 01:02:44.159806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:456 started Sep 25 01:02:44.172904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0bf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=893000000,duration_sec=926,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:44.179381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:02:44.180050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:456 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.020 Sep 25 01:02:46.160376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:457 started Sep 25 01:02:46.163473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0c1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=889000000,duration_sec=928,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:46.164093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:02:46.164451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:457 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:02:48.161461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:458 started Sep 25 01:02:48.168083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0c3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=892000000,duration_sec=930,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:48.169662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:02:48.170368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:458 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 25 01:02:49.439081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b4ad963a-d6a0-4227-9237-672f525c71cd tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:02:48Z,data_plane_status=None,description='',device_id='eb66c484-73f0-441b-a575-f506a0caca8a',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=7589db85-95c8-412c-a8f7-5db156ef7906,mac_address=fa:16:3e:d1:f2:35,name='',network_id=c62c61a7-64ad-4bd4-8ce7-b21b978664a6,numa_affinity_policy=,project_id='69a3d6ce251e480d866a86ed9f6f2eb9',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(7589db85-95c8-412c-a8f7-5db156ef7906),security_group_ids=set([601e3316-8b17-4b11-acb6-e60b3d5c5c7f]),status='DOWN',updated_at=2022-09-25T01:02:49Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:49.440209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b4ad963a-d6a0-4227-9237-672f525c71cd tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (7589db85-95c8-412c-a8f7-5db156ef7906), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:49.441239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b4ad963a-d6a0-4227-9237-672f525c71cd tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Security group member updated {'601e3316-8b17-4b11-acb6-e60b3d5c5c7f'} Sep 25 01:02:50.076012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8ad2f482-e014-4566-bc52-78b8a0250232 service neutron] Resource Port 7589db85-95c8-412c-a8f7-5db156ef7906 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=7589db85-95c8-412c-a8f7-5db156ef7906,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=7589db85-95c8-412c-a8f7-5db156ef7906,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:02:50.076623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8ad2f482-e014-4566-bc52-78b8a0250232 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (7589db85-95c8-412c-a8f7-5db156ef7906), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:50.162927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:459 started Sep 25 01:02:50.166872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0c5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=892000000,duration_sec=932,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:50.168111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:02:50.168804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:459 - starting polling. Elapsed:0.006 Sep 25 01:02:50.173343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:50.178888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:459 - port information retrieved. Elapsed:0.016 Sep 25 01:02:50.179324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:459 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Sep 25 01:02:50.506284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8ad2f482-e014-4566-bc52-78b8a0250232 service neutron] Resource Port 7589db85-95c8-412c-a8f7-5db156ef7906 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=7589db85-95c8-412c-a8f7-5db156ef7906,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=7589db85-95c8-412c-a8f7-5db156ef7906,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=7589db85-95c8-412c-a8f7-5db156ef7906,segment=NetworkSegment(94789acf-3520-42cb-8735-238d89a1ebc7),segment_id=94789acf-3520-42cb-8735-238d89a1ebc7)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:02:50.507283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8ad2f482-e014-4566-bc52-78b8a0250232 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (7589db85-95c8-412c-a8f7-5db156ef7906), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:52.163685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:460 started Sep 25 01:02:52.167028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0c7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=892000000,duration_sec=934,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:52.167873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:02:52.168286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:460 - starting polling. Elapsed:0.005 Sep 25 01:02:52.173478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:52.178308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:460 - port information retrieved. Elapsed:0.015 Sep 25 01:02:52.178762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:460 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Sep 25 01:02:53.599294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-59425f02-c23e-4298-915b-29532070a147 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:02:53Z,description='Default security group',id=2b0ed6cb-27d8-42f8-87e9-ced37db08fdf,is_default=True,name='default',project_id='282fbaf5c62d42f894c4798e46ff5100',revision_number=1,rules=[SecurityGroupRule(2115fcbe-8827-4d6d-a116-0968a776f50e),SecurityGroupRule(c162bc3f-ae0e-40c7-b37d-411d888a2a75),SecurityGroupRule(d9a42a77-41db-4351-b9b9-4f65868714f7),SecurityGroupRule(f224a488-307e-4bbe-9990-abcfed583545)],shared=False,stateful=True,updated_at=2022-09-25T01:02:53Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:53.607177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-59425f02-c23e-4298-915b-29532070a147 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (2b0ed6cb-27d8-42f8-87e9-ced37db08fdf), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:53.610600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-59425f02-c23e-4298-915b-29532070a147 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:53Z,description=,direction='egress',ethertype='IPv6',id=2115fcbe-8827-4d6d-a116-0968a776f50e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='282fbaf5c62d42f894c4798e46ff5100',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2b0ed6cb-27d8-42f8-87e9-ced37db08fdf,updated_at=2022-09-25T01:02:53Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:53.611673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-59425f02-c23e-4298-915b-29532070a147 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (2115fcbe-8827-4d6d-a116-0968a776f50e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:53.612581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-59425f02-c23e-4298-915b-29532070a147 admin admin] Security group rule updated ['2b0ed6cb-27d8-42f8-87e9-ced37db08fdf'] Sep 25 01:02:53.615066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-59425f02-c23e-4298-915b-29532070a147 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:53Z,description=,direction='egress',ethertype='IPv4',id=c162bc3f-ae0e-40c7-b37d-411d888a2a75,normalized_cidr=None,port_range_max=,port_range_min=,project_id='282fbaf5c62d42f894c4798e46ff5100',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2b0ed6cb-27d8-42f8-87e9-ced37db08fdf,updated_at=2022-09-25T01:02:53Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:53.619297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-59425f02-c23e-4298-915b-29532070a147 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (c162bc3f-ae0e-40c7-b37d-411d888a2a75), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:53.619801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-59425f02-c23e-4298-915b-29532070a147 admin admin] Security group rule updated ['2b0ed6cb-27d8-42f8-87e9-ced37db08fdf'] Sep 25 01:02:53.620688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-59425f02-c23e-4298-915b-29532070a147 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:53Z,description=,direction='ingress',ethertype='IPv6',id=d9a42a77-41db-4351-b9b9-4f65868714f7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='282fbaf5c62d42f894c4798e46ff5100',protocol=,remote_address_group_id=,remote_group_id=2b0ed6cb-27d8-42f8-87e9-ced37db08fdf,remote_ip_prefix=,revision_number=0,security_group_id=2b0ed6cb-27d8-42f8-87e9-ced37db08fdf,updated_at=2022-09-25T01:02:53Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:53.621164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-59425f02-c23e-4298-915b-29532070a147 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (d9a42a77-41db-4351-b9b9-4f65868714f7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:53.621632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-59425f02-c23e-4298-915b-29532070a147 admin admin] Security group rule updated ['2b0ed6cb-27d8-42f8-87e9-ced37db08fdf'] Sep 25 01:02:53.622736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-59425f02-c23e-4298-915b-29532070a147 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:02:53Z,description=,direction='ingress',ethertype='IPv4',id=f224a488-307e-4bbe-9990-abcfed583545,normalized_cidr=None,port_range_max=,port_range_min=,project_id='282fbaf5c62d42f894c4798e46ff5100',protocol=,remote_address_group_id=,remote_group_id=2b0ed6cb-27d8-42f8-87e9-ced37db08fdf,remote_ip_prefix=,revision_number=0,security_group_id=2b0ed6cb-27d8-42f8-87e9-ced37db08fdf,updated_at=2022-09-25T01:02:53Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:02:53.623379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-59425f02-c23e-4298-915b-29532070a147 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f224a488-307e-4bbe-9990-abcfed583545), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:53.624075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-59425f02-c23e-4298-915b-29532070a147 admin admin] Security group rule updated ['2b0ed6cb-27d8-42f8-87e9-ced37db08fdf'] Sep 25 01:02:53.910288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3d83b28f-4ce9-451f-87eb-94c911208c44 admin admin] Resource SecurityGroup deleted: 2b0ed6cb-27d8-42f8-87e9-ced37db08fdf {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:53.912211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3d83b28f-4ce9-451f-87eb-94c911208c44 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (2b0ed6cb-27d8-42f8-87e9-ced37db08fdf), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:53.914708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d83b28f-4ce9-451f-87eb-94c911208c44 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2b0ed6cb-27d8-42f8-87e9-ced37db08fdf',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:02:53.936344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3d83b28f-4ce9-451f-87eb-94c911208c44 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2b0ed6cb-27d8-42f8-87e9-ced37db08fdf',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:02:53.937245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3d83b28f-4ce9-451f-87eb-94c911208c44 admin admin] Resource SecurityGroupRule deleted: 2115fcbe-8827-4d6d-a116-0968a776f50e {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:53.938449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3d83b28f-4ce9-451f-87eb-94c911208c44 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (2115fcbe-8827-4d6d-a116-0968a776f50e), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:53.939071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-3d83b28f-4ce9-451f-87eb-94c911208c44 admin admin] Security group rule updated ['2b0ed6cb-27d8-42f8-87e9-ced37db08fdf'] Sep 25 01:02:53.939694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3d83b28f-4ce9-451f-87eb-94c911208c44 admin admin] Resource SecurityGroupRule deleted: c162bc3f-ae0e-40c7-b37d-411d888a2a75 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:53.940133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3d83b28f-4ce9-451f-87eb-94c911208c44 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (c162bc3f-ae0e-40c7-b37d-411d888a2a75), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:53.940515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-3d83b28f-4ce9-451f-87eb-94c911208c44 admin admin] Security group rule updated ['2b0ed6cb-27d8-42f8-87e9-ced37db08fdf'] Sep 25 01:02:53.940950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3d83b28f-4ce9-451f-87eb-94c911208c44 admin admin] Resource SecurityGroupRule deleted: d9a42a77-41db-4351-b9b9-4f65868714f7 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:53.941406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3d83b28f-4ce9-451f-87eb-94c911208c44 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (d9a42a77-41db-4351-b9b9-4f65868714f7), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:53.941969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-3d83b28f-4ce9-451f-87eb-94c911208c44 admin admin] Security group rule updated ['2b0ed6cb-27d8-42f8-87e9-ced37db08fdf'] Sep 25 01:02:53.942483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3d83b28f-4ce9-451f-87eb-94c911208c44 admin admin] Resource SecurityGroupRule deleted: f224a488-307e-4bbe-9990-abcfed583545 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:53.943817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3d83b28f-4ce9-451f-87eb-94c911208c44 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f224a488-307e-4bbe-9990-abcfed583545), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:53.944206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-3d83b28f-4ce9-451f-87eb-94c911208c44 admin admin] Security group rule updated ['2b0ed6cb-27d8-42f8-87e9-ced37db08fdf'] Sep 25 01:02:54.165509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:461 started Sep 25 01:02:54.175607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0c9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=895000000,duration_sec=936,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:54.176567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:02:54.177552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:461 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 25 01:02:56.166649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:462 started Sep 25 01:02:56.170371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0cb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=895000000,duration_sec=938,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:56.171180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:02:56.171716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:462 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:02:57.831009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4a43bc53-50c9-4c82-9c98-cab8497e5573 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource Port deleted: e90855c6-13bf-47db-8fb7-7226a222a0c7 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:02:57.832140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4a43bc53-50c9-4c82-9c98-cab8497e5573 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (e90855c6-13bf-47db-8fb7-7226a222a0c7), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:57.832495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-4a43bc53-50c9-4c82-9c98-cab8497e5573 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group member updated {'02453046-f588-47d0-980a-e2cdbf9b7e63'} Sep 25 01:02:58.168083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:463 started Sep 25 01:02:58.173085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0cd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=897000000,duration_sec=940,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:02:58.174824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:02:58.175763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:463 - starting polling. Elapsed:0.008 Sep 25 01:02:58.183256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:02:58.187204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port e90855c6-13bf-47db-8fb7-7226a222a0c7 not present in bridge br-int Sep 25 01:02:58.187925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:02:58.188346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['e90855c6-13bf-47db-8fb7-7226a222a0c7'] Sep 25 01:02:58.188796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port e90855c6-13bf-47db-8fb7-7226a222a0c7 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:02:58.199341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:463 - port information retrieved. Elapsed:0.031 Sep 25 01:02:58.199666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:463 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.032 Sep 25 01:02:59.969377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 7589db85-95c8-412c-a8f7-5db156ef7906 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:02:59.970170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (7589db85-95c8-412c-a8f7-5db156ef7906), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:00.169188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:464 started Sep 25 01:03:00.171697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0cf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=897000000,duration_sec=942,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:00.172327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:03:00.172694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:464 - starting polling. Elapsed:0.004 Sep 25 01:03:00.175749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:00.180845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:464 - port information retrieved. Elapsed:0.012 Sep 25 01:03:00.181180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:464 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 25 01:03:00.463137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-77ba7f44-2bd7-444d-84c9-e7e94a2da719 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource SecurityGroup deleted: 02453046-f588-47d0-980a-e2cdbf9b7e63 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:00.463733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-77ba7f44-2bd7-444d-84c9-e7e94a2da719 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (02453046-f588-47d0-980a-e2cdbf9b7e63), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:00.464292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77ba7f44-2bd7-444d-84c9-e7e94a2da719 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('02453046-f588-47d0-980a-e2cdbf9b7e63',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:03:00.514299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-77ba7f44-2bd7-444d-84c9-e7e94a2da719 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('02453046-f588-47d0-980a-e2cdbf9b7e63',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:03:00.514978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-77ba7f44-2bd7-444d-84c9-e7e94a2da719 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource SecurityGroupRule deleted: 305bb5ce-7e2c-47f2-b76f-de23830a3b95 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:00.515515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-77ba7f44-2bd7-444d-84c9-e7e94a2da719 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (305bb5ce-7e2c-47f2-b76f-de23830a3b95), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:00.515964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-77ba7f44-2bd7-444d-84c9-e7e94a2da719 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['02453046-f588-47d0-980a-e2cdbf9b7e63'] Sep 25 01:03:00.516476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-77ba7f44-2bd7-444d-84c9-e7e94a2da719 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource SecurityGroupRule deleted: ca539ce3-1b3b-44aa-9b11-e41d03b3d698 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:00.516964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-77ba7f44-2bd7-444d-84c9-e7e94a2da719 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (ca539ce3-1b3b-44aa-9b11-e41d03b3d698), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:00.517434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-77ba7f44-2bd7-444d-84c9-e7e94a2da719 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['02453046-f588-47d0-980a-e2cdbf9b7e63'] Sep 25 01:03:00.518064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-77ba7f44-2bd7-444d-84c9-e7e94a2da719 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource SecurityGroupRule deleted: bee06c7e-ffa8-4455-9e6c-370d95c180cb {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:00.518490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-77ba7f44-2bd7-444d-84c9-e7e94a2da719 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (bee06c7e-ffa8-4455-9e6c-370d95c180cb), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:00.518888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-77ba7f44-2bd7-444d-84c9-e7e94a2da719 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['02453046-f588-47d0-980a-e2cdbf9b7e63'] Sep 25 01:03:00.519359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-77ba7f44-2bd7-444d-84c9-e7e94a2da719 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource SecurityGroupRule deleted: a3e6fa55-e72f-446b-a5d0-3e3f68aab6e3 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:00.519979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-77ba7f44-2bd7-444d-84c9-e7e94a2da719 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (a3e6fa55-e72f-446b-a5d0-3e3f68aab6e3), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:00.520582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-77ba7f44-2bd7-444d-84c9-e7e94a2da719 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Security group rule updated ['02453046-f588-47d0-980a-e2cdbf9b7e63'] Sep 25 01:03:00.929523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a7e78491-7382-4a42-9a45-50e45765a954 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Resource Port deleted: 6d04309b-156a-47f4-98a2-5f2787c74a4a {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:00.930412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a7e78491-7382-4a42-9a45-50e45765a954 tempest-AttachVolumeNegativeTest-381704141 tempest-AttachVolumeNegativeTest-381704141-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (6d04309b-156a-47f4-98a2-5f2787c74a4a), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:01.938772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 7589db85-95c8-412c-a8f7-5db156ef7906 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:03:01.939821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (7589db85-95c8-412c-a8f7-5db156ef7906), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:02.172153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:465 started Sep 25 01:03:02.177642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0d1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=902000000,duration_sec=944,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:02.178534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:03:02.178976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:465 - starting polling. Elapsed:0.007 Sep 25 01:03:02.182228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:02.184719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 6d04309b-156a-47f4-98a2-5f2787c74a4a not present in bridge br-int Sep 25 01:03:02.185069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:03:02.185420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['6d04309b-156a-47f4-98a2-5f2787c74a4a'] Sep 25 01:03:02.185758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 6d04309b-156a-47f4-98a2-5f2787c74a4a is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:03:02.190093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:465 - port information retrieved. Elapsed:0.018 Sep 25 01:03:02.190265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:465 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.019 Sep 25 01:03:04.173151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:466 started Sep 25 01:03:04.177834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0d3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=902000000,duration_sec=946,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:04.178482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:03:04.179294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:466 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:03:05.153627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6fa99b71-ebfc-4cc1-be33-34e0c1143dc6 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:03:04Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=e648c726-bd59-4f54-9ff1-4c8597b65cff,mac_address=fa:16:3e:c9:fe:2a,name='',network_id=62195cd6-54fa-4e24-9d47-ae0de6356ac2,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(e648c726-bd59-4f54-9ff1-4c8597b65cff),security_group_ids=set([]),status='N/A',updated_at=2022-09-25T01:03:04Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:05.154417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6fa99b71-ebfc-4cc1-be33-34e0c1143dc6 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (e648c726-bd59-4f54-9ff1-4c8597b65cff), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:06.173723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:467 started Sep 25 01:03:06.177238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0d5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=902000000,duration_sec=948,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:06.178155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:03:06.178635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:467 - starting polling. Elapsed:0.005 Sep 25 01:03:06.181814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:06.186154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:467 - port information retrieved. Elapsed:0.013 Sep 25 01:03:06.186633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:467 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 25 01:03:06.428140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6fa99b71-ebfc-4cc1-be33-34e0c1143dc6 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Resource Port e648c726-bd59-4f54-9ff1-4c8597b65cff updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '84f3d6f1-2cc2-46d6-a12a-690bd0203084'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:03:06.428529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6fa99b71-ebfc-4cc1-be33-34e0c1143dc6 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (e648c726-bd59-4f54-9ff1-4c8597b65cff), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:06.494088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7253c83c-2bf6-48d7-a5cc-75f333215806 admin admin] Resource Port deleted: a62d43a0-f84e-4f0c-bde1-8e3aa339843e {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:06.495023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7253c83c-2bf6-48d7-a5cc-75f333215806 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (a62d43a0-f84e-4f0c-bde1-8e3aa339843e), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:07.905141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["559165ca-87bb-4fa7-8992-049b5fd82c70","delete","qr-a62d43a0-f8",12,["map",[["attached-mac","fa:16:3e:18:22:67"],["iface-id","a62d43a0-f84e-4f0c-bde1-8e3aa339843e"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:03:08.175414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:468 started Sep 25 01:03:08.236778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0d7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=954000000,duration_sec=950,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:08.238151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:03:08.239236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:468 - starting polling. Elapsed:0.064 Sep 25 01:03:08.244724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:08.259461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e0d9,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 12}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:08.260295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:468 - port information retrieved. Elapsed:0.085 Sep 25 01:03:08.261056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', '41a4501b-2acb-4e3d-a37d-bedbcdc6c76d', '8a22f42d-c327-4ae1-9e34-d8947d30272d', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb', '5f7cf548-5cfd-4292-be0b-8779295d8830', 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'd18a3c48-8be7-45c0-8641-dd3182b273bc', 'dc092d9f-c63d-420c-8856-ecb381597fd7', '312a0875-9d08-4c94-b6f3-3135500afa6a', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '71ee88f3-d4ca-4676-ab1f-7494784204fa', '4a688d1f-1335-463f-b319-bcba153c442f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'de4727a2-569d-44c6-a53e-ecc89817f610', 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92'}, 'added': set(), 'removed': {'a62d43a0-f84e-4f0c-bde1-8e3aa339843e'}, 'updated': set(), 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:03:08.261708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:468 - agent port security group processed in 0.000 Sep 25 01:03:08.268278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up [] and devices down [] completed. Sep 25 01:03:08.268900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for {'a62d43a0-f84e-4f0c-bde1-8e3aa339843e'} Sep 25 01:03:08.269936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 4 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:03:08.328470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd807f9-e09a-4815-9115-3f056bb45aed]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:03:08.329128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Ports {'a62d43a0-f84e-4f0c-bde1-8e3aa339843e'} removed Sep 25 01:03:08.385876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port removal failed for set() {{(pid=107261) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 25 01:03:08.386856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:468 - treat_devices_removed completed in 0.118 Sep 25 01:03:08.387328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:468 - ports processed. Elapsed:0.212 Sep 25 01:03:08.387965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:468 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.213 Sep 25 01:03:08.404598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-af6dc794-4c52-4c78-81a7-8da3e973ec60 admin admin] Resource Port deleted: 0fd59bde-e230-44a6-9879-6a2bbb95a5fb {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:08.405230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-af6dc794-4c52-4c78-81a7-8da3e973ec60 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (0fd59bde-e230-44a6-9879-6a2bbb95a5fb), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:08.922845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["9d854122-702d-42bb-8143-5ac095a8cfba","delete","qg-0fd59bde-e2",9,["map",[["attached-mac","fa:16:3e:aa:4d:d4"],["iface-id","0fd59bde-e230-44a6-9879-6a2bbb95a5fb"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:03:09.085556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fb765d33-22a9-4117-9919-53105c90cb5a admin admin] Resource Subnet deleted: 0e647c01-1f0c-448e-8162-e47ee7cb9c90 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:09.085933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fb765d33-22a9-4117-9919-53105c90cb5a admin admin] Publish callbacks [] for Subnet (0e647c01-1f0c-448e-8162-e47ee7cb9c90), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:09.259233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["484dc974-5585-4f15-9546-d03b46c49d97","delete","tap5f7cf548-5c",6,["map",[["attached-mac","fa:16:3e:11:bb:d9"],["iface-id","5f7cf548-5cfd-4292-be0b-8779295d8830"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:03:09.472187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-41f54919-35c2-4b0e-8499-fcd4641dc994 admin admin] Resource Port deleted: 5f7cf548-5cfd-4292-be0b-8779295d8830 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:09.474575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-41f54919-35c2-4b0e-8499-fcd4641dc994 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (5f7cf548-5cfd-4292-be0b-8779295d8830), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:09.624038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2f8ff7bb-a977-44e8-b69d-06782bb3d8e4 None None] Resource Port deleted: 5f7cf548-5cfd-4292-be0b-8779295d8830 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:09.624476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2f8ff7bb-a977-44e8-b69d-06782bb3d8e4 None None] Skipped duplicate delete event for 5f7cf548-5cfd-4292-be0b-8779295d8830 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 25 01:03:09.814914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-41f54919-35c2-4b0e-8499-fcd4641dc994 admin admin] Resource Network deleted: 5dc49b54-686c-4619-ad4c-65c72c26fd31 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:09.815482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-41f54919-35c2-4b0e-8499-fcd4641dc994 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (5dc49b54-686c-4619-ad4c-65c72c26fd31), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:10.168864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a8404158-4456-4921-ae22-2ee10cbf5fff admin admin] Resource SecurityGroup deleted: 1dc05fbe-29d1-4128-a9ac-c675fde8a879 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:10.169975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a8404158-4456-4921-ae22-2ee10cbf5fff admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (1dc05fbe-29d1-4128-a9ac-c675fde8a879), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:10.170160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8404158-4456-4921-ae22-2ee10cbf5fff admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('1dc05fbe-29d1-4128-a9ac-c675fde8a879',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:03:10.177983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:469 started Sep 25 01:03:10.181433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0db,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=906000000,duration_sec=952,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:10.182527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:03:10.183211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:469 - starting polling. Elapsed:0.006 Sep 25 01:03:10.185916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:10.190831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a8404158-4456-4921-ae22-2ee10cbf5fff admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('1dc05fbe-29d1-4128-a9ac-c675fde8a879',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:03:10.191461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a8404158-4456-4921-ae22-2ee10cbf5fff admin admin] Resource SecurityGroupRule deleted: 77a0adcd-19d4-46fa-90cb-887d9588b434 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:10.192343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a8404158-4456-4921-ae22-2ee10cbf5fff admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (77a0adcd-19d4-46fa-90cb-887d9588b434), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:10.193017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a8404158-4456-4921-ae22-2ee10cbf5fff admin admin] Security group rule updated ['1dc05fbe-29d1-4128-a9ac-c675fde8a879'] Sep 25 01:03:10.193821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a8404158-4456-4921-ae22-2ee10cbf5fff admin admin] Resource SecurityGroupRule deleted: 988c6c16-422a-4421-b3e3-fa3599885a8d {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:10.194177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a8404158-4456-4921-ae22-2ee10cbf5fff admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (988c6c16-422a-4421-b3e3-fa3599885a8d), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:10.194496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a8404158-4456-4921-ae22-2ee10cbf5fff admin admin] Security group rule updated ['1dc05fbe-29d1-4128-a9ac-c675fde8a879'] Sep 25 01:03:10.195040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a8404158-4456-4921-ae22-2ee10cbf5fff admin admin] Resource SecurityGroupRule deleted: d2c78e94-634e-4bb4-b662-46eeb2901983 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:10.195385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a8404158-4456-4921-ae22-2ee10cbf5fff admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (d2c78e94-634e-4bb4-b662-46eeb2901983), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:10.195704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a8404158-4456-4921-ae22-2ee10cbf5fff admin admin] Security group rule updated ['1dc05fbe-29d1-4128-a9ac-c675fde8a879'] Sep 25 01:03:10.196075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a8404158-4456-4921-ae22-2ee10cbf5fff admin admin] Resource SecurityGroupRule deleted: d63c7548-40c1-4a78-9f66-45cfe094faba {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:10.196414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a8404158-4456-4921-ae22-2ee10cbf5fff admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (d63c7548-40c1-4a78-9f66-45cfe094faba), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:10.196735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a8404158-4456-4921-ae22-2ee10cbf5fff admin admin] Security group rule updated ['1dc05fbe-29d1-4128-a9ac-c675fde8a879'] Sep 25 01:03:10.199707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e0dd,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 9}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:10.202040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e0df,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 6}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:10.202354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:469 - port information retrieved. Elapsed:0.025 Sep 25 01:03:10.202691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'a08ec5e3-6360-432b-aa85-85ce1774998d', '41a4501b-2acb-4e3d-a37d-bedbcdc6c76d', '8a22f42d-c327-4ae1-9e34-d8947d30272d', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'd18a3c48-8be7-45c0-8641-dd3182b273bc', 'dc092d9f-c63d-420c-8856-ecb381597fd7', '312a0875-9d08-4c94-b6f3-3135500afa6a', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '71ee88f3-d4ca-4676-ab1f-7494784204fa', '4a688d1f-1335-463f-b319-bcba153c442f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'de4727a2-569d-44c6-a53e-ecc89817f610', 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92'}, 'added': set(), 'removed': {'5f7cf548-5cfd-4292-be0b-8779295d8830', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb'}, 'updated': set(), 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:03:10.203018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:469 - agent port security group processed in 0.000 Sep 25 01:03:10.205642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up [] and devices down [] completed. Sep 25 01:03:10.205951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for {'5f7cf548-5cfd-4292-be0b-8779295d8830', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb'} Sep 25 01:03:10.206450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 8 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:03:10.260613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[249acbf6-2850-423c-936e-85a0fcc100f7]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:03:10.261732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Ports {'5f7cf548-5cfd-4292-be0b-8779295d8830', '0fd59bde-e230-44a6-9879-6a2bbb95a5fb'} removed Sep 25 01:03:10.346799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port removal failed for set() {{(pid=107261) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 25 01:03:10.347401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Reclaiming vlan = 4 from net-id = 5dc49b54-686c-4619-ad4c-65c72c26fd31, seg-id = 71 Sep 25 01:03:10.351450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xa5d7ab58,OFPFlowMod(buffer_id=4294967295,command=3,cookie=13979250796582379444,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4100}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:10.354184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x7834e0e1,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4167}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:10.354602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:469 - treat_devices_removed completed in 0.149 Sep 25 01:03:10.354895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:469 - ports processed. Elapsed:0.178 Sep 25 01:03:10.355222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:469 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.178 Sep 25 01:03:12.107583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-736fef90-d7d4-447c-9d75-6d79b3d08627 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:03:11Z,description='Default security group',id=806a8c1d-f702-4dd5-ac9a-b734406954a6,is_default=True,name='default',project_id='3b39228a17314fa49ffb00c024e7dc68',revision_number=1,rules=[SecurityGroupRule(97fc063e-8861-4fe8-b4d8-70c942fe2346),SecurityGroupRule(9c8729f3-fdbb-49d6-93d1-5c8a55610dae),SecurityGroupRule(a0c66274-e4a9-4701-b7e1-c8da6066bb58),SecurityGroupRule(aea01744-80dd-4ccd-aa8d-949bd182458e)],shared=False,stateful=True,updated_at=2022-09-25T01:03:11Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:12.108552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-736fef90-d7d4-447c-9d75-6d79b3d08627 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (806a8c1d-f702-4dd5-ac9a-b734406954a6), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:12.109190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-736fef90-d7d4-447c-9d75-6d79b3d08627 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:11Z,description=,direction='egress',ethertype='IPv4',id=97fc063e-8861-4fe8-b4d8-70c942fe2346,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3b39228a17314fa49ffb00c024e7dc68',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=806a8c1d-f702-4dd5-ac9a-b734406954a6,updated_at=2022-09-25T01:03:11Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:12.110018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-736fef90-d7d4-447c-9d75-6d79b3d08627 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (97fc063e-8861-4fe8-b4d8-70c942fe2346), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:12.110489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-736fef90-d7d4-447c-9d75-6d79b3d08627 admin admin] Security group rule updated ['806a8c1d-f702-4dd5-ac9a-b734406954a6'] Sep 25 01:03:12.111384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-736fef90-d7d4-447c-9d75-6d79b3d08627 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:12Z,description=,direction='egress',ethertype='IPv6',id=9c8729f3-fdbb-49d6-93d1-5c8a55610dae,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3b39228a17314fa49ffb00c024e7dc68',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=806a8c1d-f702-4dd5-ac9a-b734406954a6,updated_at=2022-09-25T01:03:12Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:12.111870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-736fef90-d7d4-447c-9d75-6d79b3d08627 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (9c8729f3-fdbb-49d6-93d1-5c8a55610dae), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:12.112558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-736fef90-d7d4-447c-9d75-6d79b3d08627 admin admin] Security group rule updated ['806a8c1d-f702-4dd5-ac9a-b734406954a6'] Sep 25 01:03:12.114086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-736fef90-d7d4-447c-9d75-6d79b3d08627 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:12Z,description=,direction='ingress',ethertype='IPv6',id=a0c66274-e4a9-4701-b7e1-c8da6066bb58,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3b39228a17314fa49ffb00c024e7dc68',protocol=,remote_address_group_id=,remote_group_id=806a8c1d-f702-4dd5-ac9a-b734406954a6,remote_ip_prefix=,revision_number=0,security_group_id=806a8c1d-f702-4dd5-ac9a-b734406954a6,updated_at=2022-09-25T01:03:12Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:12.114663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-736fef90-d7d4-447c-9d75-6d79b3d08627 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (a0c66274-e4a9-4701-b7e1-c8da6066bb58), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:12.115171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-736fef90-d7d4-447c-9d75-6d79b3d08627 admin admin] Security group rule updated ['806a8c1d-f702-4dd5-ac9a-b734406954a6'] Sep 25 01:03:12.116186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-736fef90-d7d4-447c-9d75-6d79b3d08627 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:11Z,description=,direction='ingress',ethertype='IPv4',id=aea01744-80dd-4ccd-aa8d-949bd182458e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3b39228a17314fa49ffb00c024e7dc68',protocol=,remote_address_group_id=,remote_group_id=806a8c1d-f702-4dd5-ac9a-b734406954a6,remote_ip_prefix=,revision_number=0,security_group_id=806a8c1d-f702-4dd5-ac9a-b734406954a6,updated_at=2022-09-25T01:03:11Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:12.116965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-736fef90-d7d4-447c-9d75-6d79b3d08627 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (aea01744-80dd-4ccd-aa8d-949bd182458e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:12.117837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-736fef90-d7d4-447c-9d75-6d79b3d08627 admin admin] Security group rule updated ['806a8c1d-f702-4dd5-ac9a-b734406954a6'] Sep 25 01:03:12.178276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:470 started Sep 25 01:03:12.181679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0e3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=907000000,duration_sec=954,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:12.182424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:03:12.182995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:470 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:03:12.276568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-18b4bd85-04f2-4458-ab38-9bd963d1fc12 admin admin] Resource SecurityGroup deleted: 806a8c1d-f702-4dd5-ac9a-b734406954a6 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:12.277228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-18b4bd85-04f2-4458-ab38-9bd963d1fc12 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (806a8c1d-f702-4dd5-ac9a-b734406954a6), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:12.278041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18b4bd85-04f2-4458-ab38-9bd963d1fc12 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('806a8c1d-f702-4dd5-ac9a-b734406954a6',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:03:12.301665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-18b4bd85-04f2-4458-ab38-9bd963d1fc12 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('806a8c1d-f702-4dd5-ac9a-b734406954a6',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:03:12.302431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-18b4bd85-04f2-4458-ab38-9bd963d1fc12 admin admin] Resource SecurityGroupRule deleted: 97fc063e-8861-4fe8-b4d8-70c942fe2346 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:12.303071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-18b4bd85-04f2-4458-ab38-9bd963d1fc12 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (97fc063e-8861-4fe8-b4d8-70c942fe2346), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:12.303574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-18b4bd85-04f2-4458-ab38-9bd963d1fc12 admin admin] Security group rule updated ['806a8c1d-f702-4dd5-ac9a-b734406954a6'] Sep 25 01:03:12.304089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-18b4bd85-04f2-4458-ab38-9bd963d1fc12 admin admin] Resource SecurityGroupRule deleted: 9c8729f3-fdbb-49d6-93d1-5c8a55610dae {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:12.304567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-18b4bd85-04f2-4458-ab38-9bd963d1fc12 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (9c8729f3-fdbb-49d6-93d1-5c8a55610dae), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:12.305387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-18b4bd85-04f2-4458-ab38-9bd963d1fc12 admin admin] Security group rule updated ['806a8c1d-f702-4dd5-ac9a-b734406954a6'] Sep 25 01:03:12.305993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-18b4bd85-04f2-4458-ab38-9bd963d1fc12 admin admin] Resource SecurityGroupRule deleted: a0c66274-e4a9-4701-b7e1-c8da6066bb58 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:12.306449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-18b4bd85-04f2-4458-ab38-9bd963d1fc12 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (a0c66274-e4a9-4701-b7e1-c8da6066bb58), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:12.306764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-18b4bd85-04f2-4458-ab38-9bd963d1fc12 admin admin] Security group rule updated ['806a8c1d-f702-4dd5-ac9a-b734406954a6'] Sep 25 01:03:12.307230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-18b4bd85-04f2-4458-ab38-9bd963d1fc12 admin admin] Resource SecurityGroupRule deleted: aea01744-80dd-4ccd-aa8d-949bd182458e {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:12.307621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-18b4bd85-04f2-4458-ab38-9bd963d1fc12 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (aea01744-80dd-4ccd-aa8d-949bd182458e), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:12.308042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-18b4bd85-04f2-4458-ab38-9bd963d1fc12 admin admin] Security group rule updated ['806a8c1d-f702-4dd5-ac9a-b734406954a6'] Sep 25 01:03:14.179532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:471 started Sep 25 01:03:14.184228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0e5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=908000000,duration_sec=956,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:14.185147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:03:14.186078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:471 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:03:16.180730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:472 started Sep 25 01:03:16.188508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0e7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=909000000,duration_sec=958,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:16.189333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:03:16.189696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:472 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 25 01:03:18.181476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:473 started Sep 25 01:03:18.184279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0e9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=910000000,duration_sec=960,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:18.184878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:03:18.185239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:473 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:03:20.182155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:474 started Sep 25 01:03:20.185313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0eb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=910000000,duration_sec=962,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:20.186273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:03:20.186643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:474 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:03:22.183468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:475 started Sep 25 01:03:22.186985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0ed,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=912000000,duration_sec=964,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:22.187823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:03:22.188402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:475 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:03:24.184470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:476 started Sep 25 01:03:24.187017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0ef,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=913000000,duration_sec=966,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:24.187590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:03:24.187944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:476 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:03:24.292670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2a5f5045-229d-4f4c-a9e2-f47cb648031d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:03:24Z,description='Default security group',id=3e77490b-0e28-49fd-b6f7-12fe1b2996da,is_default=True,name='default',project_id='70c044369bd84c5c92793c8b5a8842f2',revision_number=1,rules=[SecurityGroupRule(11f69d51-ba38-46e3-ae97-db00c34e2a6a),SecurityGroupRule(24b6acf8-0b38-46cc-b091-b961c57744e8),SecurityGroupRule(a5f95583-71f2-4497-9e64-ec5abce4385d),SecurityGroupRule(bf501515-5a4f-41d4-b7c2-d7028ab68a92)],shared=False,stateful=True,updated_at=2022-09-25T01:03:24Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:24.293633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2a5f5045-229d-4f4c-a9e2-f47cb648031d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (3e77490b-0e28-49fd-b6f7-12fe1b2996da), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:24.295018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2a5f5045-229d-4f4c-a9e2-f47cb648031d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:24Z,description=,direction='ingress',ethertype='IPv6',id=11f69d51-ba38-46e3-ae97-db00c34e2a6a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='70c044369bd84c5c92793c8b5a8842f2',protocol=,remote_address_group_id=,remote_group_id=3e77490b-0e28-49fd-b6f7-12fe1b2996da,remote_ip_prefix=,revision_number=0,security_group_id=3e77490b-0e28-49fd-b6f7-12fe1b2996da,updated_at=2022-09-25T01:03:24Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:24.296129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2a5f5045-229d-4f4c-a9e2-f47cb648031d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (11f69d51-ba38-46e3-ae97-db00c34e2a6a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:24.297152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2a5f5045-229d-4f4c-a9e2-f47cb648031d admin admin] Security group rule updated ['3e77490b-0e28-49fd-b6f7-12fe1b2996da'] Sep 25 01:03:24.298967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2a5f5045-229d-4f4c-a9e2-f47cb648031d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:24Z,description=,direction='egress',ethertype='IPv6',id=24b6acf8-0b38-46cc-b091-b961c57744e8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='70c044369bd84c5c92793c8b5a8842f2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3e77490b-0e28-49fd-b6f7-12fe1b2996da,updated_at=2022-09-25T01:03:24Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:24.300131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2a5f5045-229d-4f4c-a9e2-f47cb648031d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (24b6acf8-0b38-46cc-b091-b961c57744e8), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:24.301459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2a5f5045-229d-4f4c-a9e2-f47cb648031d admin admin] Security group rule updated ['3e77490b-0e28-49fd-b6f7-12fe1b2996da'] Sep 25 01:03:24.302711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2a5f5045-229d-4f4c-a9e2-f47cb648031d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:24Z,description=,direction='egress',ethertype='IPv4',id=a5f95583-71f2-4497-9e64-ec5abce4385d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='70c044369bd84c5c92793c8b5a8842f2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3e77490b-0e28-49fd-b6f7-12fe1b2996da,updated_at=2022-09-25T01:03:24Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:24.303198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2a5f5045-229d-4f4c-a9e2-f47cb648031d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (a5f95583-71f2-4497-9e64-ec5abce4385d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:24.303762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2a5f5045-229d-4f4c-a9e2-f47cb648031d admin admin] Security group rule updated ['3e77490b-0e28-49fd-b6f7-12fe1b2996da'] Sep 25 01:03:24.304984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2a5f5045-229d-4f4c-a9e2-f47cb648031d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:24Z,description=,direction='ingress',ethertype='IPv4',id=bf501515-5a4f-41d4-b7c2-d7028ab68a92,normalized_cidr=None,port_range_max=,port_range_min=,project_id='70c044369bd84c5c92793c8b5a8842f2',protocol=,remote_address_group_id=,remote_group_id=3e77490b-0e28-49fd-b6f7-12fe1b2996da,remote_ip_prefix=,revision_number=0,security_group_id=3e77490b-0e28-49fd-b6f7-12fe1b2996da,updated_at=2022-09-25T01:03:24Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:24.305637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2a5f5045-229d-4f4c-a9e2-f47cb648031d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (bf501515-5a4f-41d4-b7c2-d7028ab68a92), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:24.306203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2a5f5045-229d-4f4c-a9e2-f47cb648031d admin admin] Security group rule updated ['3e77490b-0e28-49fd-b6f7-12fe1b2996da'] Sep 25 01:03:24.500619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-68cacc07-0c97-4536-94eb-c59690f8d57d admin admin] Resource SecurityGroup deleted: 3e77490b-0e28-49fd-b6f7-12fe1b2996da {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:24.501403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-68cacc07-0c97-4536-94eb-c59690f8d57d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (3e77490b-0e28-49fd-b6f7-12fe1b2996da), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:24.502203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68cacc07-0c97-4536-94eb-c59690f8d57d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('3e77490b-0e28-49fd-b6f7-12fe1b2996da',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:03:24.558270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-68cacc07-0c97-4536-94eb-c59690f8d57d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('3e77490b-0e28-49fd-b6f7-12fe1b2996da',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:03:24.559149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-68cacc07-0c97-4536-94eb-c59690f8d57d admin admin] Resource SecurityGroupRule deleted: 11f69d51-ba38-46e3-ae97-db00c34e2a6a {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:24.560067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-68cacc07-0c97-4536-94eb-c59690f8d57d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (11f69d51-ba38-46e3-ae97-db00c34e2a6a), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:24.560634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-68cacc07-0c97-4536-94eb-c59690f8d57d admin admin] Security group rule updated ['3e77490b-0e28-49fd-b6f7-12fe1b2996da'] Sep 25 01:03:24.561792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-68cacc07-0c97-4536-94eb-c59690f8d57d admin admin] Resource SecurityGroupRule deleted: 24b6acf8-0b38-46cc-b091-b961c57744e8 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:24.562366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-68cacc07-0c97-4536-94eb-c59690f8d57d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (24b6acf8-0b38-46cc-b091-b961c57744e8), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:24.562912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-68cacc07-0c97-4536-94eb-c59690f8d57d admin admin] Security group rule updated ['3e77490b-0e28-49fd-b6f7-12fe1b2996da'] Sep 25 01:03:24.563569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-68cacc07-0c97-4536-94eb-c59690f8d57d admin admin] Resource SecurityGroupRule deleted: a5f95583-71f2-4497-9e64-ec5abce4385d {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:24.564316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-68cacc07-0c97-4536-94eb-c59690f8d57d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (a5f95583-71f2-4497-9e64-ec5abce4385d), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:24.564855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-68cacc07-0c97-4536-94eb-c59690f8d57d admin admin] Security group rule updated ['3e77490b-0e28-49fd-b6f7-12fe1b2996da'] Sep 25 01:03:24.565527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-68cacc07-0c97-4536-94eb-c59690f8d57d admin admin] Resource SecurityGroupRule deleted: bf501515-5a4f-41d4-b7c2-d7028ab68a92 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:24.566732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-68cacc07-0c97-4536-94eb-c59690f8d57d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (bf501515-5a4f-41d4-b7c2-d7028ab68a92), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:24.567383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-68cacc07-0c97-4536-94eb-c59690f8d57d admin admin] Security group rule updated ['3e77490b-0e28-49fd-b6f7-12fe1b2996da'] Sep 25 01:03:25.179101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2c604e0a-b3da-48e7-828d-1ebd05080a7a admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:03:24Z,description='Default security group',id=41f3f5aa-a7cc-4bf1-b48b-9900edd3b7ec,is_default=True,name='default',project_id='38ed0c63f8ff49348d59d8d5deb6dfd9',revision_number=1,rules=[SecurityGroupRule(091ee87f-dc8c-400d-9c28-6a4b42cb1c46),SecurityGroupRule(5346dc31-148b-4f10-a81d-465fc3fe56a8),SecurityGroupRule(8e13316b-4a2c-4355-816d-c61c4c981c3b),SecurityGroupRule(b20317ab-4bab-4930-b519-606a342209db)],shared=False,stateful=True,updated_at=2022-09-25T01:03:25Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:25.179600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2c604e0a-b3da-48e7-828d-1ebd05080a7a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (41f3f5aa-a7cc-4bf1-b48b-9900edd3b7ec), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:25.180387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2c604e0a-b3da-48e7-828d-1ebd05080a7a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:25Z,description=,direction='egress',ethertype='IPv6',id=091ee87f-dc8c-400d-9c28-6a4b42cb1c46,normalized_cidr=None,port_range_max=,port_range_min=,project_id='38ed0c63f8ff49348d59d8d5deb6dfd9',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=41f3f5aa-a7cc-4bf1-b48b-9900edd3b7ec,updated_at=2022-09-25T01:03:25Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:25.180808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2c604e0a-b3da-48e7-828d-1ebd05080a7a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (091ee87f-dc8c-400d-9c28-6a4b42cb1c46), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:25.181322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2c604e0a-b3da-48e7-828d-1ebd05080a7a admin admin] Security group rule updated ['41f3f5aa-a7cc-4bf1-b48b-9900edd3b7ec'] Sep 25 01:03:25.182097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2c604e0a-b3da-48e7-828d-1ebd05080a7a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:25Z,description=,direction='ingress',ethertype='IPv4',id=5346dc31-148b-4f10-a81d-465fc3fe56a8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='38ed0c63f8ff49348d59d8d5deb6dfd9',protocol=,remote_address_group_id=,remote_group_id=41f3f5aa-a7cc-4bf1-b48b-9900edd3b7ec,remote_ip_prefix=,revision_number=0,security_group_id=41f3f5aa-a7cc-4bf1-b48b-9900edd3b7ec,updated_at=2022-09-25T01:03:25Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:25.182511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2c604e0a-b3da-48e7-828d-1ebd05080a7a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (5346dc31-148b-4f10-a81d-465fc3fe56a8), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:25.182921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2c604e0a-b3da-48e7-828d-1ebd05080a7a admin admin] Security group rule updated ['41f3f5aa-a7cc-4bf1-b48b-9900edd3b7ec'] Sep 25 01:03:25.183787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2c604e0a-b3da-48e7-828d-1ebd05080a7a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:25Z,description=,direction='ingress',ethertype='IPv6',id=8e13316b-4a2c-4355-816d-c61c4c981c3b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='38ed0c63f8ff49348d59d8d5deb6dfd9',protocol=,remote_address_group_id=,remote_group_id=41f3f5aa-a7cc-4bf1-b48b-9900edd3b7ec,remote_ip_prefix=,revision_number=0,security_group_id=41f3f5aa-a7cc-4bf1-b48b-9900edd3b7ec,updated_at=2022-09-25T01:03:25Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:25.184242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2c604e0a-b3da-48e7-828d-1ebd05080a7a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (8e13316b-4a2c-4355-816d-c61c4c981c3b), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:25.184641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2c604e0a-b3da-48e7-828d-1ebd05080a7a admin admin] Security group rule updated ['41f3f5aa-a7cc-4bf1-b48b-9900edd3b7ec'] Sep 25 01:03:25.185802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2c604e0a-b3da-48e7-828d-1ebd05080a7a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:25Z,description=,direction='egress',ethertype='IPv4',id=b20317ab-4bab-4930-b519-606a342209db,normalized_cidr=None,port_range_max=,port_range_min=,project_id='38ed0c63f8ff49348d59d8d5deb6dfd9',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=41f3f5aa-a7cc-4bf1-b48b-9900edd3b7ec,updated_at=2022-09-25T01:03:25Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:25.186331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2c604e0a-b3da-48e7-828d-1ebd05080a7a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (b20317ab-4bab-4930-b519-606a342209db), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:25.186782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2c604e0a-b3da-48e7-828d-1ebd05080a7a admin admin] Security group rule updated ['41f3f5aa-a7cc-4bf1-b48b-9900edd3b7ec'] Sep 25 01:03:25.385947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5e621d1d-fb52-48df-b367-700f40832d26 admin admin] Resource SecurityGroup deleted: 41f3f5aa-a7cc-4bf1-b48b-9900edd3b7ec {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:25.386716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5e621d1d-fb52-48df-b367-700f40832d26 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (41f3f5aa-a7cc-4bf1-b48b-9900edd3b7ec), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:25.387272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e621d1d-fb52-48df-b367-700f40832d26 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('41f3f5aa-a7cc-4bf1-b48b-9900edd3b7ec',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:03:25.405712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5e621d1d-fb52-48df-b367-700f40832d26 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('41f3f5aa-a7cc-4bf1-b48b-9900edd3b7ec',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:03:25.406509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5e621d1d-fb52-48df-b367-700f40832d26 admin admin] Resource SecurityGroupRule deleted: 091ee87f-dc8c-400d-9c28-6a4b42cb1c46 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:25.407092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5e621d1d-fb52-48df-b367-700f40832d26 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (091ee87f-dc8c-400d-9c28-6a4b42cb1c46), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:25.407597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5e621d1d-fb52-48df-b367-700f40832d26 admin admin] Security group rule updated ['41f3f5aa-a7cc-4bf1-b48b-9900edd3b7ec'] Sep 25 01:03:25.408105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5e621d1d-fb52-48df-b367-700f40832d26 admin admin] Resource SecurityGroupRule deleted: 5346dc31-148b-4f10-a81d-465fc3fe56a8 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:25.408588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5e621d1d-fb52-48df-b367-700f40832d26 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (5346dc31-148b-4f10-a81d-465fc3fe56a8), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:25.409030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5e621d1d-fb52-48df-b367-700f40832d26 admin admin] Security group rule updated ['41f3f5aa-a7cc-4bf1-b48b-9900edd3b7ec'] Sep 25 01:03:25.411149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5e621d1d-fb52-48df-b367-700f40832d26 admin admin] Resource SecurityGroupRule deleted: 8e13316b-4a2c-4355-816d-c61c4c981c3b {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:25.411647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5e621d1d-fb52-48df-b367-700f40832d26 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (8e13316b-4a2c-4355-816d-c61c4c981c3b), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:25.412094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5e621d1d-fb52-48df-b367-700f40832d26 admin admin] Security group rule updated ['41f3f5aa-a7cc-4bf1-b48b-9900edd3b7ec'] Sep 25 01:03:25.413128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5e621d1d-fb52-48df-b367-700f40832d26 admin admin] Resource SecurityGroupRule deleted: b20317ab-4bab-4930-b519-606a342209db {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:25.413702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5e621d1d-fb52-48df-b367-700f40832d26 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (b20317ab-4bab-4930-b519-606a342209db), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:25.415088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5e621d1d-fb52-48df-b367-700f40832d26 admin admin] Security group rule updated ['41f3f5aa-a7cc-4bf1-b48b-9900edd3b7ec'] Sep 25 01:03:26.185820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:477 started Sep 25 01:03:26.190579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0f1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=915000000,duration_sec=968,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:26.192359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:03:26.192569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:477 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 01:03:27.788392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ce056939-b8fa-4345-bbd0-de0023fcc71e tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Resource Port deleted: 4aef1009-d2d3-4c6f-af8a-c5134e19fa37 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:27.789454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ce056939-b8fa-4345-bbd0-de0023fcc71e tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (4aef1009-d2d3-4c6f-af8a-c5134e19fa37), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:27.789454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ce056939-b8fa-4345-bbd0-de0023fcc71e tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Security group member updated {'59958eaf-fcee-40b6-ab81-ca9d2af93f77'} Sep 25 01:03:28.187220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:478 started Sep 25 01:03:28.191840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0f3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=916000000,duration_sec=970,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:28.193061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:03:28.194133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:478 - starting polling. Elapsed:0.007 Sep 25 01:03:28.210350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:28.217512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 4aef1009-d2d3-4c6f-af8a-c5134e19fa37 not present in bridge br-int Sep 25 01:03:28.217939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:03:28.221313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['4aef1009-d2d3-4c6f-af8a-c5134e19fa37'] Sep 25 01:03:28.221313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 4aef1009-d2d3-4c6f-af8a-c5134e19fa37 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:03:28.226057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:478 - port information retrieved. Elapsed:0.039 Sep 25 01:03:28.226468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:478 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.040 Sep 25 01:03:30.084614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-38cb40fc-d7c5-4617-b79b-a81097bf968a tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Resource SecurityGroup deleted: 59958eaf-fcee-40b6-ab81-ca9d2af93f77 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:30.085710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-38cb40fc-d7c5-4617-b79b-a81097bf968a tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (59958eaf-fcee-40b6-ab81-ca9d2af93f77), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:30.085978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38cb40fc-d7c5-4617-b79b-a81097bf968a tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('59958eaf-fcee-40b6-ab81-ca9d2af93f77',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:03:30.104926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-38cb40fc-d7c5-4617-b79b-a81097bf968a tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('59958eaf-fcee-40b6-ab81-ca9d2af93f77',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:03:30.105711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-38cb40fc-d7c5-4617-b79b-a81097bf968a tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Resource SecurityGroupRule deleted: 3d408c6a-63c2-4726-a13f-f3d325f806b7 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:30.106316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-38cb40fc-d7c5-4617-b79b-a81097bf968a tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (3d408c6a-63c2-4726-a13f-f3d325f806b7), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:30.106805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-38cb40fc-d7c5-4617-b79b-a81097bf968a tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Security group rule updated ['59958eaf-fcee-40b6-ab81-ca9d2af93f77'] Sep 25 01:03:30.107286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-38cb40fc-d7c5-4617-b79b-a81097bf968a tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Resource SecurityGroupRule deleted: fe705211-a645-4801-8aef-851b7d0ee4b2 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:30.107796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-38cb40fc-d7c5-4617-b79b-a81097bf968a tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (fe705211-a645-4801-8aef-851b7d0ee4b2), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:30.108248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-38cb40fc-d7c5-4617-b79b-a81097bf968a tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Security group rule updated ['59958eaf-fcee-40b6-ab81-ca9d2af93f77'] Sep 25 01:03:30.108758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-38cb40fc-d7c5-4617-b79b-a81097bf968a tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Resource SecurityGroupRule deleted: 2c3f0461-6574-40eb-a5c6-af3a3dd6b051 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:30.109540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-38cb40fc-d7c5-4617-b79b-a81097bf968a tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (2c3f0461-6574-40eb-a5c6-af3a3dd6b051), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:30.110014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-38cb40fc-d7c5-4617-b79b-a81097bf968a tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Security group rule updated ['59958eaf-fcee-40b6-ab81-ca9d2af93f77'] Sep 25 01:03:30.110527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-38cb40fc-d7c5-4617-b79b-a81097bf968a tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Resource SecurityGroupRule deleted: ea548c20-697f-4d73-98e5-f16868ccedcd {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:30.110999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-38cb40fc-d7c5-4617-b79b-a81097bf968a tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (ea548c20-697f-4d73-98e5-f16868ccedcd), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:30.111440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-38cb40fc-d7c5-4617-b79b-a81097bf968a tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Security group rule updated ['59958eaf-fcee-40b6-ab81-ca9d2af93f77'] Sep 25 01:03:30.187880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:479 started Sep 25 01:03:30.191595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0f5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=916000000,duration_sec=972,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:30.192342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:03:30.192815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:479 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:03:30.597690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-15df3f08-e16f-4bd3-b087-a5881ec8a430 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Resource Port deleted: db8603ba-673f-49bc-aa77-4747b2dc666f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:30.598299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-15df3f08-e16f-4bd3-b087-a5881ec8a430 tempest-AttachVolumeShelveTestJSON-14329766 tempest-AttachVolumeShelveTestJSON-14329766-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (db8603ba-673f-49bc-aa77-4747b2dc666f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:32.189525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:480 started Sep 25 01:03:32.194132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0f7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=919000000,duration_sec=974,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:32.196525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:03:32.196525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:480 - starting polling. Elapsed:0.006 Sep 25 01:03:32.200453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:32.202911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port db8603ba-673f-49bc-aa77-4747b2dc666f not present in bridge br-int Sep 25 01:03:32.203506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:03:32.204254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['db8603ba-673f-49bc-aa77-4747b2dc666f'] Sep 25 01:03:32.204886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port db8603ba-673f-49bc-aa77-4747b2dc666f is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:03:32.217903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:480 - port information retrieved. Elapsed:0.021 Sep 25 01:03:32.217903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:480 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.021 Sep 25 01:03:32.236331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0cf7d8ee-9592-4aff-b01b-f54bc27f2ede admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:03:32Z,description='Default security group',id=16349ca2-20b1-4843-aa2c-4c8c98653b40,is_default=True,name='default',project_id='3097e5a686514e4ab558b5941f6efe43',revision_number=1,rules=[SecurityGroupRule(497e3fbb-aa83-486a-8d65-7856d9a04547),SecurityGroupRule(4e7606a0-54b2-4e66-8be2-00e13eb34654),SecurityGroupRule(b463cffd-d78a-44ae-aa40-72538536032f),SecurityGroupRule(bc9d0251-94af-4fdb-97cc-38951428fdc7)],shared=False,stateful=True,updated_at=2022-09-25T01:03:32Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:32.237014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0cf7d8ee-9592-4aff-b01b-f54bc27f2ede admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (16349ca2-20b1-4843-aa2c-4c8c98653b40), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:32.238900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0cf7d8ee-9592-4aff-b01b-f54bc27f2ede admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:32Z,description=,direction='ingress',ethertype='IPv4',id=497e3fbb-aa83-486a-8d65-7856d9a04547,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3097e5a686514e4ab558b5941f6efe43',protocol=,remote_address_group_id=,remote_group_id=16349ca2-20b1-4843-aa2c-4c8c98653b40,remote_ip_prefix=,revision_number=0,security_group_id=16349ca2-20b1-4843-aa2c-4c8c98653b40,updated_at=2022-09-25T01:03:32Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:32.239550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0cf7d8ee-9592-4aff-b01b-f54bc27f2ede admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (497e3fbb-aa83-486a-8d65-7856d9a04547), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:32.240134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-0cf7d8ee-9592-4aff-b01b-f54bc27f2ede admin admin] Security group rule updated ['16349ca2-20b1-4843-aa2c-4c8c98653b40'] Sep 25 01:03:32.241444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0cf7d8ee-9592-4aff-b01b-f54bc27f2ede admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:32Z,description=,direction='egress',ethertype='IPv4',id=4e7606a0-54b2-4e66-8be2-00e13eb34654,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3097e5a686514e4ab558b5941f6efe43',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=16349ca2-20b1-4843-aa2c-4c8c98653b40,updated_at=2022-09-25T01:03:32Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:32.242082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0cf7d8ee-9592-4aff-b01b-f54bc27f2ede admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (4e7606a0-54b2-4e66-8be2-00e13eb34654), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:32.242669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-0cf7d8ee-9592-4aff-b01b-f54bc27f2ede admin admin] Security group rule updated ['16349ca2-20b1-4843-aa2c-4c8c98653b40'] Sep 25 01:03:32.243917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0cf7d8ee-9592-4aff-b01b-f54bc27f2ede admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:32Z,description=,direction='egress',ethertype='IPv6',id=b463cffd-d78a-44ae-aa40-72538536032f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3097e5a686514e4ab558b5941f6efe43',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=16349ca2-20b1-4843-aa2c-4c8c98653b40,updated_at=2022-09-25T01:03:32Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:32.244547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0cf7d8ee-9592-4aff-b01b-f54bc27f2ede admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (b463cffd-d78a-44ae-aa40-72538536032f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:32.245162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-0cf7d8ee-9592-4aff-b01b-f54bc27f2ede admin admin] Security group rule updated ['16349ca2-20b1-4843-aa2c-4c8c98653b40'] Sep 25 01:03:32.246450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0cf7d8ee-9592-4aff-b01b-f54bc27f2ede admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:32Z,description=,direction='ingress',ethertype='IPv6',id=bc9d0251-94af-4fdb-97cc-38951428fdc7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3097e5a686514e4ab558b5941f6efe43',protocol=,remote_address_group_id=,remote_group_id=16349ca2-20b1-4843-aa2c-4c8c98653b40,remote_ip_prefix=,revision_number=0,security_group_id=16349ca2-20b1-4843-aa2c-4c8c98653b40,updated_at=2022-09-25T01:03:32Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:32.247053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0cf7d8ee-9592-4aff-b01b-f54bc27f2ede admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (bc9d0251-94af-4fdb-97cc-38951428fdc7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:32.247611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-0cf7d8ee-9592-4aff-b01b-f54bc27f2ede admin admin] Security group rule updated ['16349ca2-20b1-4843-aa2c-4c8c98653b40'] Sep 25 01:03:32.462695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e4308a25-c51d-414a-b783-887a0e9c20a7 admin admin] Resource SecurityGroup deleted: 16349ca2-20b1-4843-aa2c-4c8c98653b40 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:32.463102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e4308a25-c51d-414a-b783-887a0e9c20a7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (16349ca2-20b1-4843-aa2c-4c8c98653b40), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:32.463578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4308a25-c51d-414a-b783-887a0e9c20a7 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('16349ca2-20b1-4843-aa2c-4c8c98653b40',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:03:32.490721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e4308a25-c51d-414a-b783-887a0e9c20a7 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('16349ca2-20b1-4843-aa2c-4c8c98653b40',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:03:32.491249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e4308a25-c51d-414a-b783-887a0e9c20a7 admin admin] Resource SecurityGroupRule deleted: 497e3fbb-aa83-486a-8d65-7856d9a04547 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:32.491663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e4308a25-c51d-414a-b783-887a0e9c20a7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (497e3fbb-aa83-486a-8d65-7856d9a04547), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:32.492005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-e4308a25-c51d-414a-b783-887a0e9c20a7 admin admin] Security group rule updated ['16349ca2-20b1-4843-aa2c-4c8c98653b40'] Sep 25 01:03:32.492369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e4308a25-c51d-414a-b783-887a0e9c20a7 admin admin] Resource SecurityGroupRule deleted: 4e7606a0-54b2-4e66-8be2-00e13eb34654 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:32.492750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e4308a25-c51d-414a-b783-887a0e9c20a7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (4e7606a0-54b2-4e66-8be2-00e13eb34654), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:32.493216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-e4308a25-c51d-414a-b783-887a0e9c20a7 admin admin] Security group rule updated ['16349ca2-20b1-4843-aa2c-4c8c98653b40'] Sep 25 01:03:32.493513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e4308a25-c51d-414a-b783-887a0e9c20a7 admin admin] Resource SecurityGroupRule deleted: b463cffd-d78a-44ae-aa40-72538536032f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:32.493873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e4308a25-c51d-414a-b783-887a0e9c20a7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (b463cffd-d78a-44ae-aa40-72538536032f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:32.494198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-e4308a25-c51d-414a-b783-887a0e9c20a7 admin admin] Security group rule updated ['16349ca2-20b1-4843-aa2c-4c8c98653b40'] Sep 25 01:03:32.494649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e4308a25-c51d-414a-b783-887a0e9c20a7 admin admin] Resource SecurityGroupRule deleted: bc9d0251-94af-4fdb-97cc-38951428fdc7 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:32.494998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e4308a25-c51d-414a-b783-887a0e9c20a7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (bc9d0251-94af-4fdb-97cc-38951428fdc7), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:32.495313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-e4308a25-c51d-414a-b783-887a0e9c20a7 admin admin] Security group rule updated ['16349ca2-20b1-4843-aa2c-4c8c98653b40'] Sep 25 01:03:33.025138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0d46b307-3fcc-4c3b-abd7-3c4051418f61 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:03:32Z,description='Default security group',id=e5e6f307-2452-4280-8fb8-6dac83f168d2,is_default=True,name='default',project_id='954dbc1f2fb246f98a56ee695b836bc2',revision_number=1,rules=[SecurityGroupRule(16b710af-27ac-41f4-8510-efd6819bc8da),SecurityGroupRule(6ba39cba-56f0-45f1-8994-2fe5e390289d),SecurityGroupRule(969e7026-5fff-4dc9-86f6-68b10b2cb954),SecurityGroupRule(f166cd60-4cdf-4f8e-81b4-2a9a3b9224a0)],shared=False,stateful=True,updated_at=2022-09-25T01:03:32Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:33.025731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0d46b307-3fcc-4c3b-abd7-3c4051418f61 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (e5e6f307-2452-4280-8fb8-6dac83f168d2), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:33.026495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0d46b307-3fcc-4c3b-abd7-3c4051418f61 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:32Z,description=,direction='ingress',ethertype='IPv6',id=16b710af-27ac-41f4-8510-efd6819bc8da,normalized_cidr=None,port_range_max=,port_range_min=,project_id='954dbc1f2fb246f98a56ee695b836bc2',protocol=,remote_address_group_id=,remote_group_id=e5e6f307-2452-4280-8fb8-6dac83f168d2,remote_ip_prefix=,revision_number=0,security_group_id=e5e6f307-2452-4280-8fb8-6dac83f168d2,updated_at=2022-09-25T01:03:32Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:33.027151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0d46b307-3fcc-4c3b-abd7-3c4051418f61 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (16b710af-27ac-41f4-8510-efd6819bc8da), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:33.027671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-0d46b307-3fcc-4c3b-abd7-3c4051418f61 admin admin] Security group rule updated ['e5e6f307-2452-4280-8fb8-6dac83f168d2'] Sep 25 01:03:33.028648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0d46b307-3fcc-4c3b-abd7-3c4051418f61 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:32Z,description=,direction='ingress',ethertype='IPv4',id=6ba39cba-56f0-45f1-8994-2fe5e390289d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='954dbc1f2fb246f98a56ee695b836bc2',protocol=,remote_address_group_id=,remote_group_id=e5e6f307-2452-4280-8fb8-6dac83f168d2,remote_ip_prefix=,revision_number=0,security_group_id=e5e6f307-2452-4280-8fb8-6dac83f168d2,updated_at=2022-09-25T01:03:32Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:33.029139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0d46b307-3fcc-4c3b-abd7-3c4051418f61 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (6ba39cba-56f0-45f1-8994-2fe5e390289d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:33.029687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-0d46b307-3fcc-4c3b-abd7-3c4051418f61 admin admin] Security group rule updated ['e5e6f307-2452-4280-8fb8-6dac83f168d2'] Sep 25 01:03:33.030802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0d46b307-3fcc-4c3b-abd7-3c4051418f61 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:32Z,description=,direction='egress',ethertype='IPv4',id=969e7026-5fff-4dc9-86f6-68b10b2cb954,normalized_cidr=None,port_range_max=,port_range_min=,project_id='954dbc1f2fb246f98a56ee695b836bc2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e5e6f307-2452-4280-8fb8-6dac83f168d2,updated_at=2022-09-25T01:03:32Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:33.031244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0d46b307-3fcc-4c3b-abd7-3c4051418f61 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (969e7026-5fff-4dc9-86f6-68b10b2cb954), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:33.031699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-0d46b307-3fcc-4c3b-abd7-3c4051418f61 admin admin] Security group rule updated ['e5e6f307-2452-4280-8fb8-6dac83f168d2'] Sep 25 01:03:33.032485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0d46b307-3fcc-4c3b-abd7-3c4051418f61 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:32Z,description=,direction='egress',ethertype='IPv6',id=f166cd60-4cdf-4f8e-81b4-2a9a3b9224a0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='954dbc1f2fb246f98a56ee695b836bc2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e5e6f307-2452-4280-8fb8-6dac83f168d2,updated_at=2022-09-25T01:03:32Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:33.032951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0d46b307-3fcc-4c3b-abd7-3c4051418f61 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f166cd60-4cdf-4f8e-81b4-2a9a3b9224a0), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:33.033476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-0d46b307-3fcc-4c3b-abd7-3c4051418f61 admin admin] Security group rule updated ['e5e6f307-2452-4280-8fb8-6dac83f168d2'] Sep 25 01:03:33.192543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-cc97194b-d67a-4fd7-a125-b714412d77ba admin admin] Resource SecurityGroup deleted: e5e6f307-2452-4280-8fb8-6dac83f168d2 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:33.193358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-cc97194b-d67a-4fd7-a125-b714412d77ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (e5e6f307-2452-4280-8fb8-6dac83f168d2), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:33.193903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc97194b-d67a-4fd7-a125-b714412d77ba admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e5e6f307-2452-4280-8fb8-6dac83f168d2',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:03:33.214949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-cc97194b-d67a-4fd7-a125-b714412d77ba admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e5e6f307-2452-4280-8fb8-6dac83f168d2',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:03:33.215708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-cc97194b-d67a-4fd7-a125-b714412d77ba admin admin] Resource SecurityGroupRule deleted: 16b710af-27ac-41f4-8510-efd6819bc8da {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:33.216312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-cc97194b-d67a-4fd7-a125-b714412d77ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (16b710af-27ac-41f4-8510-efd6819bc8da), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:33.216869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-cc97194b-d67a-4fd7-a125-b714412d77ba admin admin] Security group rule updated ['e5e6f307-2452-4280-8fb8-6dac83f168d2'] Sep 25 01:03:33.217581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-cc97194b-d67a-4fd7-a125-b714412d77ba admin admin] Resource SecurityGroupRule deleted: 6ba39cba-56f0-45f1-8994-2fe5e390289d {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:33.218166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-cc97194b-d67a-4fd7-a125-b714412d77ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (6ba39cba-56f0-45f1-8994-2fe5e390289d), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:33.218720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-cc97194b-d67a-4fd7-a125-b714412d77ba admin admin] Security group rule updated ['e5e6f307-2452-4280-8fb8-6dac83f168d2'] Sep 25 01:03:33.219374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-cc97194b-d67a-4fd7-a125-b714412d77ba admin admin] Resource SecurityGroupRule deleted: 969e7026-5fff-4dc9-86f6-68b10b2cb954 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:33.220043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-cc97194b-d67a-4fd7-a125-b714412d77ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (969e7026-5fff-4dc9-86f6-68b10b2cb954), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:33.220587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-cc97194b-d67a-4fd7-a125-b714412d77ba admin admin] Security group rule updated ['e5e6f307-2452-4280-8fb8-6dac83f168d2'] Sep 25 01:03:33.221428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-cc97194b-d67a-4fd7-a125-b714412d77ba admin admin] Resource SecurityGroupRule deleted: f166cd60-4cdf-4f8e-81b4-2a9a3b9224a0 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:33.222101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-cc97194b-d67a-4fd7-a125-b714412d77ba admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f166cd60-4cdf-4f8e-81b4-2a9a3b9224a0), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:33.222686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-cc97194b-d67a-4fd7-a125-b714412d77ba admin admin] Security group rule updated ['e5e6f307-2452-4280-8fb8-6dac83f168d2'] Sep 25 01:03:34.190500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:481 started Sep 25 01:03:34.194484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0f9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=919000000,duration_sec=976,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:34.195490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:03:34.195960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:481 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:03:34.962232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ab3eae8b-14fc-417c-81cc-d6fefac9a831 admin admin] Resource Port deleted: a08ec5e3-6360-432b-aa85-85ce1774998d {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:34.962831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ab3eae8b-14fc-417c-81cc-d6fefac9a831 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (a08ec5e3-6360-432b-aa85-85ce1774998d), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:36.192005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:482 started Sep 25 01:03:36.197447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0fb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=923000000,duration_sec=978,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:36.198396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:03:36.198955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:482 - starting polling. Elapsed:0.007 Sep 25 01:03:36.205462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:36.218871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-a08ec5e3-63, col_values=(('tag', 4095),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:03:36.249111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e0fd,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 17}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:36.249451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['a08ec5e3-6360-432b-aa85-85ce1774998d'] Sep 25 01:03:36.249908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 4 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:03:36.333201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2b05d8-f9b3-4254-9256-1e87db3087da]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:03:36.342268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:482 - port information retrieved. Elapsed:0.150 Sep 25 01:03:36.343527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:482 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.151 Sep 25 01:03:36.540935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-09aa949e-3151-4608-af81-520053dab6f0 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:03:36Z,description='Default security group',id=a0491801-3e65-4b19-a371-953ad4ec0d94,is_default=True,name='default',project_id='33eac46fae8d4b0ba481dbc87f4cc3c6',revision_number=1,rules=[SecurityGroupRule(6ccf2971-8c84-4a58-bc59-7485b7657715),SecurityGroupRule(8b75c68f-2bcc-492f-8935-ba6663616ae3),SecurityGroupRule(a7fd2225-359b-46f1-8fb5-0e4e18ffd537),SecurityGroupRule(f973436e-0e68-4ae6-834b-484634ddd6ba)],shared=False,stateful=True,updated_at=2022-09-25T01:03:36Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:36.542013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-09aa949e-3151-4608-af81-520053dab6f0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (a0491801-3e65-4b19-a371-953ad4ec0d94), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:36.543937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-09aa949e-3151-4608-af81-520053dab6f0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:36Z,description=,direction='ingress',ethertype='IPv4',id=6ccf2971-8c84-4a58-bc59-7485b7657715,normalized_cidr=None,port_range_max=,port_range_min=,project_id='33eac46fae8d4b0ba481dbc87f4cc3c6',protocol=,remote_address_group_id=,remote_group_id=a0491801-3e65-4b19-a371-953ad4ec0d94,remote_ip_prefix=,revision_number=0,security_group_id=a0491801-3e65-4b19-a371-953ad4ec0d94,updated_at=2022-09-25T01:03:36Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:36.544565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-09aa949e-3151-4608-af81-520053dab6f0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (6ccf2971-8c84-4a58-bc59-7485b7657715), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:36.545166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-09aa949e-3151-4608-af81-520053dab6f0 admin admin] Security group rule updated ['a0491801-3e65-4b19-a371-953ad4ec0d94'] Sep 25 01:03:36.550068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-09aa949e-3151-4608-af81-520053dab6f0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:36Z,description=,direction='egress',ethertype='IPv6',id=8b75c68f-2bcc-492f-8935-ba6663616ae3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='33eac46fae8d4b0ba481dbc87f4cc3c6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a0491801-3e65-4b19-a371-953ad4ec0d94,updated_at=2022-09-25T01:03:36Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:36.551394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-09aa949e-3151-4608-af81-520053dab6f0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (8b75c68f-2bcc-492f-8935-ba6663616ae3), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:36.552098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-09aa949e-3151-4608-af81-520053dab6f0 admin admin] Security group rule updated ['a0491801-3e65-4b19-a371-953ad4ec0d94'] Sep 25 01:03:36.553215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-09aa949e-3151-4608-af81-520053dab6f0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:36Z,description=,direction='ingress',ethertype='IPv6',id=a7fd2225-359b-46f1-8fb5-0e4e18ffd537,normalized_cidr=None,port_range_max=,port_range_min=,project_id='33eac46fae8d4b0ba481dbc87f4cc3c6',protocol=,remote_address_group_id=,remote_group_id=a0491801-3e65-4b19-a371-953ad4ec0d94,remote_ip_prefix=,revision_number=0,security_group_id=a0491801-3e65-4b19-a371-953ad4ec0d94,updated_at=2022-09-25T01:03:36Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:36.553916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-09aa949e-3151-4608-af81-520053dab6f0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (a7fd2225-359b-46f1-8fb5-0e4e18ffd537), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:36.554538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-09aa949e-3151-4608-af81-520053dab6f0 admin admin] Security group rule updated ['a0491801-3e65-4b19-a371-953ad4ec0d94'] Sep 25 01:03:36.555348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-09aa949e-3151-4608-af81-520053dab6f0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:36Z,description=,direction='egress',ethertype='IPv4',id=f973436e-0e68-4ae6-834b-484634ddd6ba,normalized_cidr=None,port_range_max=,port_range_min=,project_id='33eac46fae8d4b0ba481dbc87f4cc3c6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a0491801-3e65-4b19-a371-953ad4ec0d94,updated_at=2022-09-25T01:03:36Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:36.555966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-09aa949e-3151-4608-af81-520053dab6f0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f973436e-0e68-4ae6-834b-484634ddd6ba), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:36.556525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-09aa949e-3151-4608-af81-520053dab6f0 admin admin] Security group rule updated ['a0491801-3e65-4b19-a371-953ad4ec0d94'] Sep 25 01:03:36.590944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["1d4ef316-765c-4509-b537-8c0d85c448b2","delete","qr-a08ec5e3-63",17,["map",[["attached-mac","fa:16:3e:a4:6c:86"],["iface-id","a08ec5e3-6360-432b-aa85-85ce1774998d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:03:36.690344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0518b173-9755-4de6-ba3c-5da60c64c82b admin admin] Resource Port deleted: eb9862a9-2d1e-4843-945a-d227bfbd9cd7 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:36.691953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0518b173-9755-4de6-ba3c-5da60c64c82b admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (eb9862a9-2d1e-4843-945a-d227bfbd9cd7), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:36.752542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b3d01a6d-6fdf-45b1-8888-e4e14e563f41 admin admin] Resource SecurityGroup deleted: a0491801-3e65-4b19-a371-953ad4ec0d94 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:36.753618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b3d01a6d-6fdf-45b1-8888-e4e14e563f41 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (a0491801-3e65-4b19-a371-953ad4ec0d94), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:36.754100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3d01a6d-6fdf-45b1-8888-e4e14e563f41 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('a0491801-3e65-4b19-a371-953ad4ec0d94',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:03:36.772782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b3d01a6d-6fdf-45b1-8888-e4e14e563f41 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('a0491801-3e65-4b19-a371-953ad4ec0d94',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:03:36.774056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b3d01a6d-6fdf-45b1-8888-e4e14e563f41 admin admin] Resource SecurityGroupRule deleted: 6ccf2971-8c84-4a58-bc59-7485b7657715 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:36.774767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b3d01a6d-6fdf-45b1-8888-e4e14e563f41 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (6ccf2971-8c84-4a58-bc59-7485b7657715), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:36.775621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b3d01a6d-6fdf-45b1-8888-e4e14e563f41 admin admin] Security group rule updated ['a0491801-3e65-4b19-a371-953ad4ec0d94'] Sep 25 01:03:36.776480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b3d01a6d-6fdf-45b1-8888-e4e14e563f41 admin admin] Resource SecurityGroupRule deleted: 8b75c68f-2bcc-492f-8935-ba6663616ae3 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:36.777175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b3d01a6d-6fdf-45b1-8888-e4e14e563f41 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (8b75c68f-2bcc-492f-8935-ba6663616ae3), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:36.777871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b3d01a6d-6fdf-45b1-8888-e4e14e563f41 admin admin] Security group rule updated ['a0491801-3e65-4b19-a371-953ad4ec0d94'] Sep 25 01:03:36.778615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b3d01a6d-6fdf-45b1-8888-e4e14e563f41 admin admin] Resource SecurityGroupRule deleted: a7fd2225-359b-46f1-8fb5-0e4e18ffd537 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:36.779298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b3d01a6d-6fdf-45b1-8888-e4e14e563f41 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (a7fd2225-359b-46f1-8fb5-0e4e18ffd537), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:36.779932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b3d01a6d-6fdf-45b1-8888-e4e14e563f41 admin admin] Security group rule updated ['a0491801-3e65-4b19-a371-953ad4ec0d94'] Sep 25 01:03:36.780657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b3d01a6d-6fdf-45b1-8888-e4e14e563f41 admin admin] Resource SecurityGroupRule deleted: f973436e-0e68-4ae6-834b-484634ddd6ba {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:36.781351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b3d01a6d-6fdf-45b1-8888-e4e14e563f41 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f973436e-0e68-4ae6-834b-484634ddd6ba), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:36.781973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b3d01a6d-6fdf-45b1-8888-e4e14e563f41 admin admin] Security group rule updated ['a0491801-3e65-4b19-a371-953ad4ec0d94'] Sep 25 01:03:37.063083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5e2349b2-1bd8-478d-ab46-876bedf4071b","delete","qg-eb9862a9-2d",14,["map",[["attached-mac","fa:16:3e:49:5f:60"],["iface-id","eb9862a9-2d1e-4843-945a-d227bfbd9cd7"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:03:37.438670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d23a451d-463e-4e14-bee6-15979b66d3c3 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:03:37Z,description='Default security group',id=241bbf8c-d090-4104-85be-910163532cf8,is_default=True,name='default',project_id='5c81c409e9dd480ba02daf4ca73f7a64',revision_number=1,rules=[SecurityGroupRule(180b8e39-112a-492d-9cd9-878fd835b5b0),SecurityGroupRule(904400a5-eb67-4e81-97c1-9ed30b51a6ec),SecurityGroupRule(b7d9714b-1b17-441e-aa6e-df2d90a06357),SecurityGroupRule(e263e7c5-4548-4669-8958-c8b8d2ab9d7d)],shared=False,stateful=True,updated_at=2022-09-25T01:03:37Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:37.439708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d23a451d-463e-4e14-bee6-15979b66d3c3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (241bbf8c-d090-4104-85be-910163532cf8), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:37.440625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d23a451d-463e-4e14-bee6-15979b66d3c3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:37Z,description=,direction='egress',ethertype='IPv4',id=180b8e39-112a-492d-9cd9-878fd835b5b0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5c81c409e9dd480ba02daf4ca73f7a64',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=241bbf8c-d090-4104-85be-910163532cf8,updated_at=2022-09-25T01:03:37Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:37.442676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d23a451d-463e-4e14-bee6-15979b66d3c3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (180b8e39-112a-492d-9cd9-878fd835b5b0), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:37.443254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d23a451d-463e-4e14-bee6-15979b66d3c3 admin admin] Security group rule updated ['241bbf8c-d090-4104-85be-910163532cf8'] Sep 25 01:03:37.444517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d23a451d-463e-4e14-bee6-15979b66d3c3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:37Z,description=,direction='ingress',ethertype='IPv4',id=904400a5-eb67-4e81-97c1-9ed30b51a6ec,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5c81c409e9dd480ba02daf4ca73f7a64',protocol=,remote_address_group_id=,remote_group_id=241bbf8c-d090-4104-85be-910163532cf8,remote_ip_prefix=,revision_number=0,security_group_id=241bbf8c-d090-4104-85be-910163532cf8,updated_at=2022-09-25T01:03:37Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:37.445097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d23a451d-463e-4e14-bee6-15979b66d3c3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (904400a5-eb67-4e81-97c1-9ed30b51a6ec), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:37.446854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d23a451d-463e-4e14-bee6-15979b66d3c3 admin admin] Security group rule updated ['241bbf8c-d090-4104-85be-910163532cf8'] Sep 25 01:03:37.449319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d23a451d-463e-4e14-bee6-15979b66d3c3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:37Z,description=,direction='ingress',ethertype='IPv6',id=b7d9714b-1b17-441e-aa6e-df2d90a06357,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5c81c409e9dd480ba02daf4ca73f7a64',protocol=,remote_address_group_id=,remote_group_id=241bbf8c-d090-4104-85be-910163532cf8,remote_ip_prefix=,revision_number=0,security_group_id=241bbf8c-d090-4104-85be-910163532cf8,updated_at=2022-09-25T01:03:37Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:37.450550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d23a451d-463e-4e14-bee6-15979b66d3c3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (b7d9714b-1b17-441e-aa6e-df2d90a06357), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:37.451118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d23a451d-463e-4e14-bee6-15979b66d3c3 admin admin] Security group rule updated ['241bbf8c-d090-4104-85be-910163532cf8'] Sep 25 01:03:37.452730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d23a451d-463e-4e14-bee6-15979b66d3c3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:37Z,description=,direction='egress',ethertype='IPv6',id=e263e7c5-4548-4669-8958-c8b8d2ab9d7d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5c81c409e9dd480ba02daf4ca73f7a64',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=241bbf8c-d090-4104-85be-910163532cf8,updated_at=2022-09-25T01:03:37Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:37.453366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d23a451d-463e-4e14-bee6-15979b66d3c3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (e263e7c5-4548-4669-8958-c8b8d2ab9d7d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:37.453930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d23a451d-463e-4e14-bee6-15979b66d3c3 admin admin] Security group rule updated ['241bbf8c-d090-4104-85be-910163532cf8'] Sep 25 01:03:37.499232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-be0a8155-25d1-49a2-b129-4456ffc55c29 admin admin] Resource Subnet deleted: cf3d0ae1-4d69-474f-b9d5-17c189ebf5ae {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:37.499860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-be0a8155-25d1-49a2-b129-4456ffc55c29 admin admin] Publish callbacks [] for Subnet (cf3d0ae1-4d69-474f-b9d5-17c189ebf5ae), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:37.714948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["9d655808-30a5-4bf2-aaec-471749d82c7b","delete","tap8a22f42d-c3",8,["map",[["attached-mac","fa:16:3e:73:a2:1a"],["iface-id","8a22f42d-c327-4ae1-9e34-d8947d30272d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:03:37.756931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6e1f10f8-9fd1-4837-be46-289696151f80 admin admin] Resource SecurityGroup deleted: 241bbf8c-d090-4104-85be-910163532cf8 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:37.762652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6e1f10f8-9fd1-4837-be46-289696151f80 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (241bbf8c-d090-4104-85be-910163532cf8), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:37.762652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e1f10f8-9fd1-4837-be46-289696151f80 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('241bbf8c-d090-4104-85be-910163532cf8',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:03:37.803664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6e1f10f8-9fd1-4837-be46-289696151f80 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('241bbf8c-d090-4104-85be-910163532cf8',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:03:37.804542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6e1f10f8-9fd1-4837-be46-289696151f80 admin admin] Resource SecurityGroupRule deleted: 180b8e39-112a-492d-9cd9-878fd835b5b0 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:37.805420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6e1f10f8-9fd1-4837-be46-289696151f80 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (180b8e39-112a-492d-9cd9-878fd835b5b0), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:37.805980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-6e1f10f8-9fd1-4837-be46-289696151f80 admin admin] Security group rule updated ['241bbf8c-d090-4104-85be-910163532cf8'] Sep 25 01:03:37.806853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6e1f10f8-9fd1-4837-be46-289696151f80 admin admin] Resource SecurityGroupRule deleted: 904400a5-eb67-4e81-97c1-9ed30b51a6ec {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:37.811403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6e1f10f8-9fd1-4837-be46-289696151f80 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (904400a5-eb67-4e81-97c1-9ed30b51a6ec), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:37.812014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-6e1f10f8-9fd1-4837-be46-289696151f80 admin admin] Security group rule updated ['241bbf8c-d090-4104-85be-910163532cf8'] Sep 25 01:03:37.812753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6e1f10f8-9fd1-4837-be46-289696151f80 admin admin] Resource SecurityGroupRule deleted: b7d9714b-1b17-441e-aa6e-df2d90a06357 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:37.813403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6e1f10f8-9fd1-4837-be46-289696151f80 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (b7d9714b-1b17-441e-aa6e-df2d90a06357), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:37.813980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-6e1f10f8-9fd1-4837-be46-289696151f80 admin admin] Security group rule updated ['241bbf8c-d090-4104-85be-910163532cf8'] Sep 25 01:03:37.814657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6e1f10f8-9fd1-4837-be46-289696151f80 admin admin] Resource SecurityGroupRule deleted: e263e7c5-4548-4669-8958-c8b8d2ab9d7d {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:37.815395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6e1f10f8-9fd1-4837-be46-289696151f80 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (e263e7c5-4548-4669-8958-c8b8d2ab9d7d), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:37.816180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-6e1f10f8-9fd1-4837-be46-289696151f80 admin admin] Security group rule updated ['241bbf8c-d090-4104-85be-910163532cf8'] Sep 25 01:03:38.172605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5c821490-24fa-4257-b422-f6e76205c911 admin admin] Resource Port deleted: 8a22f42d-c327-4ae1-9e34-d8947d30272d {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:38.177495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5c821490-24fa-4257-b422-f6e76205c911 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (8a22f42d-c327-4ae1-9e34-d8947d30272d), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:38.195048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:483 started Sep 25 01:03:38.202109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e0ff,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=925000000,duration_sec=980,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:38.203250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:03:38.203997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:483 - starting polling. Elapsed:0.010 Sep 25 01:03:38.207281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:38.213886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e101,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 8}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:38.218419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e103,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 17}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:38.222101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e105,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 14}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:38.224198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:483 - port information retrieved. Elapsed:0.030 Sep 25 01:03:38.224556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'41a4501b-2acb-4e3d-a37d-bedbcdc6c76d', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'd18a3c48-8be7-45c0-8641-dd3182b273bc', 'dc092d9f-c63d-420c-8856-ecb381597fd7', '312a0875-9d08-4c94-b6f3-3135500afa6a', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '71ee88f3-d4ca-4676-ab1f-7494784204fa', '4a688d1f-1335-463f-b319-bcba153c442f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'de4727a2-569d-44c6-a53e-ecc89817f610', 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92'}, 'added': set(), 'removed': {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', '8a22f42d-c327-4ae1-9e34-d8947d30272d'}, 'updated': set(), 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:03:38.224971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:483 - agent port security group processed in 0.000 Sep 25 01:03:38.227359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up [] and devices down [] completed. Sep 25 01:03:38.227924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', '8a22f42d-c327-4ae1-9e34-d8947d30272d'} Sep 25 01:03:38.228499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port a08ec5e3-6360-432b-aa85-85ce1774998d is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:03:38.229224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 8 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:03:38.291183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5b1e01-6692-4737-9373-ae700df5fd45]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:03:38.292147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Ports {'a08ec5e3-6360-432b-aa85-85ce1774998d', 'eb9862a9-2d1e-4843-945a-d227bfbd9cd7', '8a22f42d-c327-4ae1-9e34-d8947d30272d'} removed Sep 25 01:03:38.389634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ddff1de2-723e-4917-a454-e1cca785012d None None] Resource Port deleted: 8a22f42d-c327-4ae1-9e34-d8947d30272d {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:38.390509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ddff1de2-723e-4917-a454-e1cca785012d None None] Skipped duplicate delete event for 8a22f42d-c327-4ae1-9e34-d8947d30272d {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 25 01:03:38.427657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port removal failed for set() {{(pid=107261) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 25 01:03:38.428275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:03:38.428856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Reclaiming vlan = 6 from net-id = 334cdfa6-14bd-4f9b-b93c-dbd866cdb6bb, seg-id = 87 Sep 25 01:03:38.434545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xa5d7ab5a,OFPFlowMod(buffer_id=4294967295,command=3,cookie=13979250796582379444,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4102}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:38.439506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x7834e107,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4183}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:38.440727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:483 - treat_devices_removed completed in 0.212 Sep 25 01:03:38.440727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:483 - ports processed. Elapsed:0.246 Sep 25 01:03:38.441065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:483 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.247 Sep 25 01:03:38.612180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5c821490-24fa-4257-b422-f6e76205c911 admin admin] Resource Network deleted: 334cdfa6-14bd-4f9b-b93c-dbd866cdb6bb {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:38.612763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5c821490-24fa-4257-b422-f6e76205c911 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (334cdfa6-14bd-4f9b-b93c-dbd866cdb6bb), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:39.210712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1c0f908a-501d-4510-b793-9444a640d4ed admin admin] Resource SecurityGroup deleted: a82a09b8-369e-45b5-b25f-03b97f9e03ba {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:39.211797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1c0f908a-501d-4510-b793-9444a640d4ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (a82a09b8-369e-45b5-b25f-03b97f9e03ba), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:39.213363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c0f908a-501d-4510-b793-9444a640d4ed admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('a82a09b8-369e-45b5-b25f-03b97f9e03ba',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:03:39.235198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1c0f908a-501d-4510-b793-9444a640d4ed admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('a82a09b8-369e-45b5-b25f-03b97f9e03ba',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:03:39.235862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1c0f908a-501d-4510-b793-9444a640d4ed admin admin] Resource SecurityGroupRule deleted: 3a81a654-abc8-4ca3-88f7-ee7eeeabdf72 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:39.236652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1c0f908a-501d-4510-b793-9444a640d4ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (3a81a654-abc8-4ca3-88f7-ee7eeeabdf72), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:39.237155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1c0f908a-501d-4510-b793-9444a640d4ed admin admin] Security group rule updated ['a82a09b8-369e-45b5-b25f-03b97f9e03ba'] Sep 25 01:03:39.238501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1c0f908a-501d-4510-b793-9444a640d4ed admin admin] Resource SecurityGroupRule deleted: 9d7d0e90-575e-4117-99db-a401ac2050fa {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:39.239092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1c0f908a-501d-4510-b793-9444a640d4ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (9d7d0e90-575e-4117-99db-a401ac2050fa), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:39.239644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1c0f908a-501d-4510-b793-9444a640d4ed admin admin] Security group rule updated ['a82a09b8-369e-45b5-b25f-03b97f9e03ba'] Sep 25 01:03:39.240306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1c0f908a-501d-4510-b793-9444a640d4ed admin admin] Resource SecurityGroupRule deleted: ad4cc8fb-4c5c-4ac1-a06a-27398f514083 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:39.240919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1c0f908a-501d-4510-b793-9444a640d4ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (ad4cc8fb-4c5c-4ac1-a06a-27398f514083), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:39.241435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1c0f908a-501d-4510-b793-9444a640d4ed admin admin] Security group rule updated ['a82a09b8-369e-45b5-b25f-03b97f9e03ba'] Sep 25 01:03:39.242049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1c0f908a-501d-4510-b793-9444a640d4ed admin admin] Resource SecurityGroupRule deleted: ae821adf-44a8-4b18-b325-b1e6e7fc5409 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:39.242848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1c0f908a-501d-4510-b793-9444a640d4ed admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (ae821adf-44a8-4b18-b325-b1e6e7fc5409), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:39.243353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1c0f908a-501d-4510-b793-9444a640d4ed admin admin] Security group rule updated ['a82a09b8-369e-45b5-b25f-03b97f9e03ba'] Sep 25 01:03:40.195684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:484 started Sep 25 01:03:40.200837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e109,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=926000000,duration_sec=982,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:40.202005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:03:40.202929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:484 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 25 01:03:40.834975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6195fed5-d336-4279-a184-8b47a4eba713 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:03:40Z,description='Default security group',id=c3bddf5a-82c0-4c2c-acbf-b783c9d5563e,is_default=True,name='default',project_id='f37b53a21b19482b8dcac6c38505a50b',revision_number=1,rules=[SecurityGroupRule(18c0d699-02d5-4dd8-8f20-9a0f5ecbc858),SecurityGroupRule(26b70770-3252-4113-a63e-d73ae23a2404),SecurityGroupRule(7af5d1e7-6404-426b-b19f-6b2813ea44af),SecurityGroupRule(f2183100-6a5f-417d-861c-c1f323957f08)],shared=False,stateful=True,updated_at=2022-09-25T01:03:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:40.835442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6195fed5-d336-4279-a184-8b47a4eba713 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (c3bddf5a-82c0-4c2c-acbf-b783c9d5563e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:40.835985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6195fed5-d336-4279-a184-8b47a4eba713 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:40Z,description=,direction='egress',ethertype='IPv6',id=18c0d699-02d5-4dd8-8f20-9a0f5ecbc858,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f37b53a21b19482b8dcac6c38505a50b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c3bddf5a-82c0-4c2c-acbf-b783c9d5563e,updated_at=2022-09-25T01:03:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:40.836350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6195fed5-d336-4279-a184-8b47a4eba713 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (18c0d699-02d5-4dd8-8f20-9a0f5ecbc858), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:40.836690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-6195fed5-d336-4279-a184-8b47a4eba713 admin admin] Security group rule updated ['c3bddf5a-82c0-4c2c-acbf-b783c9d5563e'] Sep 25 01:03:40.837466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6195fed5-d336-4279-a184-8b47a4eba713 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:40Z,description=,direction='ingress',ethertype='IPv6',id=26b70770-3252-4113-a63e-d73ae23a2404,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f37b53a21b19482b8dcac6c38505a50b',protocol=,remote_address_group_id=,remote_group_id=c3bddf5a-82c0-4c2c-acbf-b783c9d5563e,remote_ip_prefix=,revision_number=0,security_group_id=c3bddf5a-82c0-4c2c-acbf-b783c9d5563e,updated_at=2022-09-25T01:03:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:40.837819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6195fed5-d336-4279-a184-8b47a4eba713 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (26b70770-3252-4113-a63e-d73ae23a2404), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:40.838151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-6195fed5-d336-4279-a184-8b47a4eba713 admin admin] Security group rule updated ['c3bddf5a-82c0-4c2c-acbf-b783c9d5563e'] Sep 25 01:03:40.838821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6195fed5-d336-4279-a184-8b47a4eba713 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:40Z,description=,direction='ingress',ethertype='IPv4',id=7af5d1e7-6404-426b-b19f-6b2813ea44af,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f37b53a21b19482b8dcac6c38505a50b',protocol=,remote_address_group_id=,remote_group_id=c3bddf5a-82c0-4c2c-acbf-b783c9d5563e,remote_ip_prefix=,revision_number=0,security_group_id=c3bddf5a-82c0-4c2c-acbf-b783c9d5563e,updated_at=2022-09-25T01:03:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:40.839169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6195fed5-d336-4279-a184-8b47a4eba713 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (7af5d1e7-6404-426b-b19f-6b2813ea44af), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:40.839705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-6195fed5-d336-4279-a184-8b47a4eba713 admin admin] Security group rule updated ['c3bddf5a-82c0-4c2c-acbf-b783c9d5563e'] Sep 25 01:03:40.840562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6195fed5-d336-4279-a184-8b47a4eba713 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:40Z,description=,direction='egress',ethertype='IPv4',id=f2183100-6a5f-417d-861c-c1f323957f08,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f37b53a21b19482b8dcac6c38505a50b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c3bddf5a-82c0-4c2c-acbf-b783c9d5563e,updated_at=2022-09-25T01:03:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:40.841177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6195fed5-d336-4279-a184-8b47a4eba713 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f2183100-6a5f-417d-861c-c1f323957f08), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:40.841373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-6195fed5-d336-4279-a184-8b47a4eba713 admin admin] Security group rule updated ['c3bddf5a-82c0-4c2c-acbf-b783c9d5563e'] Sep 25 01:03:41.066506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6195fed5-d336-4279-a184-8b47a4eba713 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-25T01:03:40Z,description='',dns_domain=None,id=dbea2e08-a361-48c8-95fc-03b3fc326d51,mtu=1500,name='tempest-AttachVolumeTestJSON-323029924-network',project_id='f37b53a21b19482b8dcac6c38505a50b',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(dbea2e08-a361-48c8-95fc-03b3fc326d51),segments=[NetworkSegment(ed5ec111-24e0-4aad-b5c7-8fcadf6e28a3)],shared=False,status='ACTIVE',updated_at=2022-09-25T01:03:40Z,vlan_transparent=) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:41.066813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6195fed5-d336-4279-a184-8b47a4eba713 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (dbea2e08-a361-48c8-95fc-03b3fc326d51), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:41.202807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager [None req-6195fed5-d336-4279-a184-8b47a4eba713 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network dbea2e08-a361-48c8-95fc-03b3fc326d51 with segmentation id not found. Sep 25 01:03:41.202807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 25 01:03:41.202807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 25 01:03:41.202807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 25 01:03:41.202807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 25 01:03:41.202807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 25 01:03:41.202807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 25 01:03:41.202807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 25 01:03:41.202807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 25 01:03:41.202807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 25 01:03:41.202807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 25 01:03:41.202807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 25 01:03:41.202807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 25 01:03:41.205424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 25 01:03:41.205424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 25 01:03:41.205424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 25 01:03:41.205424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network dbea2e08-a361-48c8-95fc-03b3fc326d51 with segmentation id not found. Sep 25 01:03:41.205424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Sep 25 01:03:41.502546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d74b3f4f-a04e-458a-8845-9eeee60576fd admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(42555757-9d5c-4179-bc47-bf1bc434719f)],cidr=172.20.0.0/28,created_at=2022-09-25T01:03:41Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=2e1050b6-9f20-4f3d-a5dc-be57c6013353,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-AttachVolumeTestJSON-323029924-subnet',network_id=dbea2e08-a361-48c8-95fc-03b3fc326d51,project_id='f37b53a21b19482b8dcac6c38505a50b',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-25T01:03:41Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:41.505634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d74b3f4f-a04e-458a-8845-9eeee60576fd admin admin] Publish callbacks [] for Subnet (2e1050b6-9f20-4f3d-a5dc-be57c6013353), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:42.196945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:485 started Sep 25 01:03:42.209908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e10b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=930000000,duration_sec=984,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:42.213828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:03:42.215237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:485 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.019 Sep 25 01:03:42.474791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f97f4883-5fc4-4292-96fb-084b0cbf8bd1 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:03:41Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-dbea2e08-a361-48c8-95fc-03b3fc326d51',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=025c4caf-135a-4da4-9e95-24f950bedb8b,mac_address=fa:16:3e:c2:fb:36,name='',network_id=dbea2e08-a361-48c8-95fc-03b3fc326d51,numa_affinity_policy=,project_id='f37b53a21b19482b8dcac6c38505a50b',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(025c4caf-135a-4da4-9e95-24f950bedb8b),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T01:03:42Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:42.475842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f97f4883-5fc4-4292-96fb-084b0cbf8bd1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (025c4caf-135a-4da4-9e95-24f950bedb8b), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:42.786076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9c30888c-181d-445e-ac06-f76977137aac admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:03:42Z,description='Default security group',id=42978bf8-84f9-4cab-a232-bd251331af9b,is_default=True,name='default',project_id='c6ce95ccfb2c41fb8255925082d67b4a',revision_number=1,rules=[SecurityGroupRule(95e331da-2926-46ce-a430-189e8de9a228),SecurityGroupRule(af3ac3c9-2838-4ff7-9ccc-88e99a67044b),SecurityGroupRule(b20ba2c2-5274-46ac-8f12-a890a328284c),SecurityGroupRule(ebeb9678-0afb-4794-ac88-38a4b3b0c1d4)],shared=False,stateful=True,updated_at=2022-09-25T01:03:42Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:42.787286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9c30888c-181d-445e-ac06-f76977137aac admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (42978bf8-84f9-4cab-a232-bd251331af9b), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:42.797115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9c30888c-181d-445e-ac06-f76977137aac admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:42Z,description=,direction='egress',ethertype='IPv4',id=95e331da-2926-46ce-a430-189e8de9a228,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c6ce95ccfb2c41fb8255925082d67b4a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=42978bf8-84f9-4cab-a232-bd251331af9b,updated_at=2022-09-25T01:03:42Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:42.798361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9c30888c-181d-445e-ac06-f76977137aac admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (95e331da-2926-46ce-a430-189e8de9a228), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:42.799241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9c30888c-181d-445e-ac06-f76977137aac admin admin] Security group rule updated ['42978bf8-84f9-4cab-a232-bd251331af9b'] Sep 25 01:03:42.802536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9c30888c-181d-445e-ac06-f76977137aac admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:42Z,description=,direction='ingress',ethertype='IPv4',id=af3ac3c9-2838-4ff7-9ccc-88e99a67044b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c6ce95ccfb2c41fb8255925082d67b4a',protocol=,remote_address_group_id=,remote_group_id=42978bf8-84f9-4cab-a232-bd251331af9b,remote_ip_prefix=,revision_number=0,security_group_id=42978bf8-84f9-4cab-a232-bd251331af9b,updated_at=2022-09-25T01:03:42Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:42.809376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9c30888c-181d-445e-ac06-f76977137aac admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (af3ac3c9-2838-4ff7-9ccc-88e99a67044b), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:42.810422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9c30888c-181d-445e-ac06-f76977137aac admin admin] Security group rule updated ['42978bf8-84f9-4cab-a232-bd251331af9b'] Sep 25 01:03:42.815623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9c30888c-181d-445e-ac06-f76977137aac admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:42Z,description=,direction='ingress',ethertype='IPv6',id=b20ba2c2-5274-46ac-8f12-a890a328284c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c6ce95ccfb2c41fb8255925082d67b4a',protocol=,remote_address_group_id=,remote_group_id=42978bf8-84f9-4cab-a232-bd251331af9b,remote_ip_prefix=,revision_number=0,security_group_id=42978bf8-84f9-4cab-a232-bd251331af9b,updated_at=2022-09-25T01:03:42Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:42.816796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9c30888c-181d-445e-ac06-f76977137aac admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (b20ba2c2-5274-46ac-8f12-a890a328284c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:42.817735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9c30888c-181d-445e-ac06-f76977137aac admin admin] Security group rule updated ['42978bf8-84f9-4cab-a232-bd251331af9b'] Sep 25 01:03:42.819702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9c30888c-181d-445e-ac06-f76977137aac admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:42Z,description=,direction='egress',ethertype='IPv6',id=ebeb9678-0afb-4794-ac88-38a4b3b0c1d4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c6ce95ccfb2c41fb8255925082d67b4a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=42978bf8-84f9-4cab-a232-bd251331af9b,updated_at=2022-09-25T01:03:42Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:42.820735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9c30888c-181d-445e-ac06-f76977137aac admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (ebeb9678-0afb-4794-ac88-38a4b3b0c1d4), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:42.821761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9c30888c-181d-445e-ac06-f76977137aac admin admin] Security group rule updated ['42978bf8-84f9-4cab-a232-bd251331af9b'] Sep 25 01:03:42.827528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4a26aad1-506e-47a1-b2b6-217784602eac admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:03:42Z,data_plane_status=None,description='',device_id='4b996018-6bbd-4ec4-b932-a040ccf832d9',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=0feb7341-0637-4360-9832-808376ee9e2a,mac_address=fa:16:3e:b7:67:2f,name='',network_id=62195cd6-54fa-4e24-9d47-ae0de6356ac2,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(0feb7341-0637-4360-9832-808376ee9e2a),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T01:03:42Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:42.830586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4a26aad1-506e-47a1-b2b6-217784602eac admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (0feb7341-0637-4360-9832-808376ee9e2a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:42.886039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f97f4883-5fc4-4292-96fb-084b0cbf8bd1 None None] Resource Port 025c4caf-135a-4da4-9e95-24f950bedb8b updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=025c4caf-135a-4da4-9e95-24f950bedb8b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=025c4caf-135a-4da4-9e95-24f950bedb8b,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=025c4caf-135a-4da4-9e95-24f950bedb8b,segment=NetworkSegment(ed5ec111-24e0-4aad-b5c7-8fcadf6e28a3),segment_id=ed5ec111-24e0-4aad-b5c7-8fcadf6e28a3)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:03:42.887108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f97f4883-5fc4-4292-96fb-084b0cbf8bd1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (025c4caf-135a-4da4-9e95-24f950bedb8b), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:42.996677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8656d1a0-5e76-41c3-895c-d07aad33f90e","insert","tap025c4caf-13",["set",[]],["map",[["attached-mac","fa:16:3e:c2:fb:36"],["iface-id","025c4caf-135a-4da4-9e95-24f950bedb8b"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:03:43.026807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8656d1a0-5e76-41c3-895c-d07aad33f90e","old",null,["set",[]],null],["","new","tap025c4caf-13",36,["map",[["attached-mac","fa:16:3e:c2:fb:36"],["iface-id","025c4caf-135a-4da4-9e95-24f950bedb8b"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:03:43.302595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d33990fc-8381-4518-9e31-298df19a71ce admin admin] Resource SecurityGroup deleted: 42978bf8-84f9-4cab-a232-bd251331af9b {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:43.303636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d33990fc-8381-4518-9e31-298df19a71ce admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (42978bf8-84f9-4cab-a232-bd251331af9b), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:43.304524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d33990fc-8381-4518-9e31-298df19a71ce admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('42978bf8-84f9-4cab-a232-bd251331af9b',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:03:43.331745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d33990fc-8381-4518-9e31-298df19a71ce admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('42978bf8-84f9-4cab-a232-bd251331af9b',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:03:43.332724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d33990fc-8381-4518-9e31-298df19a71ce admin admin] Resource SecurityGroupRule deleted: 95e331da-2926-46ce-a430-189e8de9a228 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:43.333591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d33990fc-8381-4518-9e31-298df19a71ce admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (95e331da-2926-46ce-a430-189e8de9a228), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:43.334197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d33990fc-8381-4518-9e31-298df19a71ce admin admin] Security group rule updated ['42978bf8-84f9-4cab-a232-bd251331af9b'] Sep 25 01:03:43.335203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d33990fc-8381-4518-9e31-298df19a71ce admin admin] Resource SecurityGroupRule deleted: af3ac3c9-2838-4ff7-9ccc-88e99a67044b {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:43.335808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d33990fc-8381-4518-9e31-298df19a71ce admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (af3ac3c9-2838-4ff7-9ccc-88e99a67044b), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:43.337941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d33990fc-8381-4518-9e31-298df19a71ce admin admin] Security group rule updated ['42978bf8-84f9-4cab-a232-bd251331af9b'] Sep 25 01:03:43.338696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d33990fc-8381-4518-9e31-298df19a71ce admin admin] Resource SecurityGroupRule deleted: b20ba2c2-5274-46ac-8f12-a890a328284c {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:43.339739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d33990fc-8381-4518-9e31-298df19a71ce admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (b20ba2c2-5274-46ac-8f12-a890a328284c), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:43.341377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d33990fc-8381-4518-9e31-298df19a71ce admin admin] Security group rule updated ['42978bf8-84f9-4cab-a232-bd251331af9b'] Sep 25 01:03:43.342467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d33990fc-8381-4518-9e31-298df19a71ce admin admin] Resource SecurityGroupRule deleted: ebeb9678-0afb-4794-ac88-38a4b3b0c1d4 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:43.343125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d33990fc-8381-4518-9e31-298df19a71ce admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (ebeb9678-0afb-4794-ac88-38a4b3b0c1d4), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:43.343692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d33990fc-8381-4518-9e31-298df19a71ce admin admin] Security group rule updated ['42978bf8-84f9-4cab-a232-bd251331af9b'] Sep 25 01:03:44.198940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:486 started Sep 25 01:03:44.207212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e10d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=929000000,duration_sec=986,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:44.208364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:03:44.209286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:486 - starting polling. Elapsed:0.011 Sep 25 01:03:44.214874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:44.219119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:486 - port information retrieved. Elapsed:0.021 Sep 25 01:03:44.219885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'41a4501b-2acb-4e3d-a37d-bedbcdc6c76d', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'd18a3c48-8be7-45c0-8641-dd3182b273bc', 'dc092d9f-c63d-420c-8856-ecb381597fd7', '312a0875-9d08-4c94-b6f3-3135500afa6a', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '71ee88f3-d4ca-4676-ab1f-7494784204fa', '4a688d1f-1335-463f-b319-bcba153c442f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', '025c4caf-135a-4da4-9e95-24f950bedb8b', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'de4727a2-569d-44c6-a53e-ecc89817f610', 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92'}, 'added': {'025c4caf-135a-4da4-9e95-24f950bedb8b'}, 'removed': set(), 'updated': {'025c4caf-135a-4da4-9e95-24f950bedb8b'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:03:44.220868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '025c4caf-135a-4da4-9e95-24f950bedb8b', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-dbea2e08-a361-48c8-95fc-03b3fc326d51', 'network_id': 'dbea2e08-a361-48c8-95fc-03b3fc326d51', 'port_id': '025c4caf-135a-4da4-9e95-24f950bedb8b', 'mac_address': 'fa:16:3e:c2:fb:36', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 60, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2e1050b6-9f20-4f3d-a5dc-be57c6013353', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 01:03:44.227237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 025c4caf-135a-4da4-9e95-24f950bedb8b {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 01:03:44.227988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 025c4caf-135a-4da4-9e95-24f950bedb8b updated. Details: {'device': '025c4caf-135a-4da4-9e95-24f950bedb8b', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-dbea2e08-a361-48c8-95fc-03b3fc326d51', 'network_id': 'dbea2e08-a361-48c8-95fc-03b3fc326d51', 'port_id': '025c4caf-135a-4da4-9e95-24f950bedb8b', 'mac_address': 'fa:16:3e:c2:fb:36', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 60, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2e1050b6-9f20-4f3d-a5dc-be57c6013353', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 25 01:03:44.228585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Assigning 14 as local vlan for net-id=dbea2e08-a361-48c8-95fc-03b3fc326d51, seg-id=60 Sep 25 01:03:44.233194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xa5d7ab5c,OFPFlowMod(buffer_id=4294967295,command=0,cookie=13979250796582379444,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4156), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4110}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:44.243165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-eea761c7-1070-4dd6-8ddd-8aeac0e506b8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:03:43Z,description='Default security group',id=1ac612a9-4af5-4562-bc5b-ce401afa63af,is_default=True,name='default',project_id='4b951ae6cc5843f2b6af8555d739bdf2',revision_number=1,rules=[SecurityGroupRule(16f24fd5-017d-4d4e-944a-49c9b834169d),SecurityGroupRule(3341f023-ff7c-4e73-be99-acdd6f09e3b2),SecurityGroupRule(a18603c1-99b8-4331-b9f5-47693defa79d),SecurityGroupRule(d681a532-a6ee-4db4-a6bb-32ed78814280)],shared=False,stateful=True,updated_at=2022-09-25T01:03:43Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:44.244054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-eea761c7-1070-4dd6-8ddd-8aeac0e506b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (1ac612a9-4af5-4562-bc5b-ce401afa63af), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:44.245439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-eea761c7-1070-4dd6-8ddd-8aeac0e506b8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:43Z,description=,direction='ingress',ethertype='IPv6',id=16f24fd5-017d-4d4e-944a-49c9b834169d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4b951ae6cc5843f2b6af8555d739bdf2',protocol=,remote_address_group_id=,remote_group_id=1ac612a9-4af5-4562-bc5b-ce401afa63af,remote_ip_prefix=,revision_number=0,security_group_id=1ac612a9-4af5-4562-bc5b-ce401afa63af,updated_at=2022-09-25T01:03:43Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:44.246358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-eea761c7-1070-4dd6-8ddd-8aeac0e506b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (16f24fd5-017d-4d4e-944a-49c9b834169d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:44.247300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-eea761c7-1070-4dd6-8ddd-8aeac0e506b8 admin admin] Security group rule updated ['1ac612a9-4af5-4562-bc5b-ce401afa63af'] Sep 25 01:03:44.249015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-eea761c7-1070-4dd6-8ddd-8aeac0e506b8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:43Z,description=,direction='egress',ethertype='IPv6',id=3341f023-ff7c-4e73-be99-acdd6f09e3b2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4b951ae6cc5843f2b6af8555d739bdf2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1ac612a9-4af5-4562-bc5b-ce401afa63af,updated_at=2022-09-25T01:03:43Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:44.250276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-eea761c7-1070-4dd6-8ddd-8aeac0e506b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (3341f023-ff7c-4e73-be99-acdd6f09e3b2), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:44.251518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-eea761c7-1070-4dd6-8ddd-8aeac0e506b8 admin admin] Security group rule updated ['1ac612a9-4af5-4562-bc5b-ce401afa63af'] Sep 25 01:03:44.253749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-eea761c7-1070-4dd6-8ddd-8aeac0e506b8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:43Z,description=,direction='egress',ethertype='IPv4',id=a18603c1-99b8-4331-b9f5-47693defa79d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4b951ae6cc5843f2b6af8555d739bdf2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1ac612a9-4af5-4562-bc5b-ce401afa63af,updated_at=2022-09-25T01:03:43Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:44.256036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-eea761c7-1070-4dd6-8ddd-8aeac0e506b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (a18603c1-99b8-4331-b9f5-47693defa79d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:44.258116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-eea761c7-1070-4dd6-8ddd-8aeac0e506b8 admin admin] Security group rule updated ['1ac612a9-4af5-4562-bc5b-ce401afa63af'] Sep 25 01:03:44.259735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-eea761c7-1070-4dd6-8ddd-8aeac0e506b8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:43Z,description=,direction='ingress',ethertype='IPv4',id=d681a532-a6ee-4db4-a6bb-32ed78814280,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4b951ae6cc5843f2b6af8555d739bdf2',protocol=,remote_address_group_id=,remote_group_id=1ac612a9-4af5-4562-bc5b-ce401afa63af,remote_ip_prefix=,revision_number=0,security_group_id=1ac612a9-4af5-4562-bc5b-ce401afa63af,updated_at=2022-09-25T01:03:43Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:44.260405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-eea761c7-1070-4dd6-8ddd-8aeac0e506b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (d681a532-a6ee-4db4-a6bb-32ed78814280), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:44.261012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-eea761c7-1070-4dd6-8ddd-8aeac0e506b8 admin admin] Security group rule updated ['1ac612a9-4af5-4562-bc5b-ce401afa63af'] Sep 25 01:03:44.266102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0x7834e10f,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4110)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4156}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:44.268619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap025c4caf-13, col_values=(('tag', 14),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:03:44.270513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap025c4caf-13, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:03:44.271809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap025c4caf-13, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:03:44.286643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap025c4caf-13, col_values=(('other_config', {'net_uuid': 'dbea2e08-a361-48c8-95fc-03b3fc326d51', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '14', 'segmentation_id': '60'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:03:44.317754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e111,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 36}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:44.319306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:486 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 17 devices currently available. Time elapsed: 0.098 Sep 25 01:03:44.319923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing device filters for 1 new devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 25 01:03:44.321387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing filters for devices {'025c4caf-135a-4da4-9e95-24f950bedb8b'} Sep 25 01:03:44.323327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 01:03:44.323947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 01:03:44.333431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:03:44.407208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7cd77f-70c6-42ff-8ea0-a76af02eb1ec]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:03:44.408067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:486 - agent port security group processed in 0.187 Sep 25 01:03:44.408910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 025c4caf-135a-4da4-9e95-24f950bedb8b to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 01:03:44.599565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-25519270-f557-4c93-9c04-0da1a8dd30c8 admin admin] Resource SecurityGroup deleted: 1ac612a9-4af5-4562-bc5b-ce401afa63af {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:44.599947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-25519270-f557-4c93-9c04-0da1a8dd30c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (1ac612a9-4af5-4562-bc5b-ce401afa63af), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:44.600429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25519270-f557-4c93-9c04-0da1a8dd30c8 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('1ac612a9-4af5-4562-bc5b-ce401afa63af',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:03:44.690327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-25519270-f557-4c93-9c04-0da1a8dd30c8 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('1ac612a9-4af5-4562-bc5b-ce401afa63af',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:03:44.693326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-25519270-f557-4c93-9c04-0da1a8dd30c8 admin admin] Resource SecurityGroupRule deleted: 16f24fd5-017d-4d4e-944a-49c9b834169d {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:44.694614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-25519270-f557-4c93-9c04-0da1a8dd30c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (16f24fd5-017d-4d4e-944a-49c9b834169d), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:44.696653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-25519270-f557-4c93-9c04-0da1a8dd30c8 admin admin] Security group rule updated ['1ac612a9-4af5-4562-bc5b-ce401afa63af'] Sep 25 01:03:44.697579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-25519270-f557-4c93-9c04-0da1a8dd30c8 admin admin] Resource SecurityGroupRule deleted: 3341f023-ff7c-4e73-be99-acdd6f09e3b2 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:44.698173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-25519270-f557-4c93-9c04-0da1a8dd30c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (3341f023-ff7c-4e73-be99-acdd6f09e3b2), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:44.698659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-25519270-f557-4c93-9c04-0da1a8dd30c8 admin admin] Security group rule updated ['1ac612a9-4af5-4562-bc5b-ce401afa63af'] Sep 25 01:03:44.699154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-25519270-f557-4c93-9c04-0da1a8dd30c8 admin admin] Resource SecurityGroupRule deleted: a18603c1-99b8-4331-b9f5-47693defa79d {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:44.699606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-25519270-f557-4c93-9c04-0da1a8dd30c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (a18603c1-99b8-4331-b9f5-47693defa79d), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:44.700037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-25519270-f557-4c93-9c04-0da1a8dd30c8 admin admin] Security group rule updated ['1ac612a9-4af5-4562-bc5b-ce401afa63af'] Sep 25 01:03:44.700520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-25519270-f557-4c93-9c04-0da1a8dd30c8 admin admin] Resource SecurityGroupRule deleted: d681a532-a6ee-4db4-a6bb-32ed78814280 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:44.700965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-25519270-f557-4c93-9c04-0da1a8dd30c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (d681a532-a6ee-4db4-a6bb-32ed78814280), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:44.701760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-25519270-f557-4c93-9c04-0da1a8dd30c8 admin admin] Security group rule updated ['1ac612a9-4af5-4562-bc5b-ce401afa63af'] Sep 25 01:03:44.722871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-51a51008-5caf-477c-bf29-ce0ece00bcf3 None None] Resource Port 025c4caf-135a-4da4-9e95-24f950bedb8b updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:03:44.723850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-51a51008-5caf-477c-bf29-ce0ece00bcf3 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (025c4caf-135a-4da4-9e95-24f950bedb8b), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:45.327523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['025c4caf-135a-4da4-9e95-24f950bedb8b'] and devices down [] completed. Sep 25 01:03:45.328513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:486 - ports processed. Elapsed:1.130 Sep 25 01:03:45.328513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:486 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:1.130 Sep 25 01:03:45.740279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-567c2707-5c87-43af-877d-3f2ada7c4508 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:03:45Z,data_plane_status=None,description='',device_id='4b996018-6bbd-4ec4-b932-a040ccf832d9',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=2f0cdd80-0129-4756-a061-a2bfb559e884,mac_address=fa:16:3e:b2:6f:aa,name='',network_id=dbea2e08-a361-48c8-95fc-03b3fc326d51,numa_affinity_policy=,project_id='f37b53a21b19482b8dcac6c38505a50b',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(2f0cdd80-0129-4756-a061-a2bfb559e884),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T01:03:45Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:45.746687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-567c2707-5c87-43af-877d-3f2ada7c4508 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (2f0cdd80-0129-4756-a061-a2bfb559e884), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:46.140003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e99d4433-6298-4d79-9887-3629b082368c None None] Resource Port 0feb7341-0637-4360-9832-808376ee9e2a updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=0feb7341-0637-4360-9832-808376ee9e2a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=0feb7341-0637-4360-9832-808376ee9e2a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:03:46.141495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e99d4433-6298-4d79-9887-3629b082368c None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (0feb7341-0637-4360-9832-808376ee9e2a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:46.200096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:487 started Sep 25 01:03:46.203589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e113,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=929000000,duration_sec=988,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:46.204625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:03:46.204967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:487 - starting polling. Elapsed:0.005 Sep 25 01:03:46.211590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:46.228451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:487 - port information retrieved. Elapsed:0.024 Sep 25 01:03:46.228843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'41a4501b-2acb-4e3d-a37d-bedbcdc6c76d', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', 'd18a3c48-8be7-45c0-8641-dd3182b273bc', 'dc092d9f-c63d-420c-8856-ecb381597fd7', '312a0875-9d08-4c94-b6f3-3135500afa6a', 'de4727a2-569d-44c6-a53e-ecc89817f610', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '71ee88f3-d4ca-4676-ab1f-7494784204fa', '4a688d1f-1335-463f-b319-bcba153c442f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', '025c4caf-135a-4da4-9e95-24f950bedb8b', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92'}, 'added': set(), 'removed': set(), 'updated': {'025c4caf-135a-4da4-9e95-24f950bedb8b'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:03:46.230078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '025c4caf-135a-4da4-9e95-24f950bedb8b', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-dbea2e08-a361-48c8-95fc-03b3fc326d51', 'network_id': 'dbea2e08-a361-48c8-95fc-03b3fc326d51', 'port_id': '025c4caf-135a-4da4-9e95-24f950bedb8b', 'mac_address': 'fa:16:3e:c2:fb:36', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 60, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2e1050b6-9f20-4f3d-a5dc-be57c6013353', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 01:03:46.242530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 025c4caf-135a-4da4-9e95-24f950bedb8b {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 01:03:46.243167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 025c4caf-135a-4da4-9e95-24f950bedb8b updated. Details: {'device': '025c4caf-135a-4da4-9e95-24f950bedb8b', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-dbea2e08-a361-48c8-95fc-03b3fc326d51', 'network_id': 'dbea2e08-a361-48c8-95fc-03b3fc326d51', 'port_id': '025c4caf-135a-4da4-9e95-24f950bedb8b', 'mac_address': 'fa:16:3e:c2:fb:36', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 60, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2e1050b6-9f20-4f3d-a5dc-be57c6013353', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 14} Sep 25 01:03:46.246398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap025c4caf-13, col_values=(('tag', 14),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:03:46.250616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap025c4caf-13, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:03:46.251500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap025c4caf-13, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:03:46.255149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 01:03:46.261930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap025c4caf-13, col_values=(('other_config', {'net_uuid': 'dbea2e08-a361-48c8-95fc-03b3fc326d51', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '60', 'tag': '14'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:03:46.263852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 01:03:46.269001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e115,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 36}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:46.270703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:487 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 17 devices currently available. Time elapsed: 0.041 Sep 25 01:03:46.271415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refreshing firewall for 1 devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 25 01:03:46.273867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refresh firewall rules Sep 25 01:03:46.275446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 01:03:46.276216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 01:03:46.283186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:03:46.377457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cbac15-6584-42ca-be26-1686ac6c7029]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:03:46.378905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:487 - agent port security group processed in 0.149 Sep 25 01:03:46.381198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 025c4caf-135a-4da4-9e95-24f950bedb8b to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 01:03:46.415815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-567c2707-5c87-43af-877d-3f2ada7c4508 admin admin] Received resource Port update without any changes: 2f0cdd80-0129-4756-a061-a2bfb559e884 {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 25 01:03:46.457480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e99d4433-6298-4d79-9887-3629b082368c None None] Resource Port 0feb7341-0637-4360-9832-808376ee9e2a updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=0feb7341-0637-4360-9832-808376ee9e2a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=0feb7341-0637-4360-9832-808376ee9e2a,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=0feb7341-0637-4360-9832-808376ee9e2a,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:03:46.463900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e99d4433-6298-4d79-9887-3629b082368c None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (0feb7341-0637-4360-9832-808376ee9e2a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:46.843454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['025c4caf-135a-4da4-9e95-24f950bedb8b'] and devices down [] completed. Sep 25 01:03:46.844574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:487 - ports processed. Elapsed:0.645 Sep 25 01:03:46.845126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:487 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.646 Sep 25 01:03:47.296079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["4fe37f04-0a1c-40fa-91d9-0575901263b0","insert","qr-2f0cdd80-01",["set",[]],["map",[["attached-mac","fa:16:3e:b2:6f:aa"],["iface-id","2f0cdd80-0129-4756-a061-a2bfb559e884"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:03:47.326345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["4fe37f04-0a1c-40fa-91d9-0575901263b0","old",null,["set",[]],null],["","new","qr-2f0cdd80-01",37,["map",[["attached-mac","fa:16:3e:b2:6f:aa"],["iface-id","2f0cdd80-0129-4756-a061-a2bfb559e884"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:03:48.036960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-29dc0ce8-d269-40ab-8eae-ff327562d55d tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:03:47Z,description='tempest-description--391514579',id=bfb86a56-b21b-42ad-94ac-a717aef8569c,is_default=False,name='tempest-securitygroup--1478945763',project_id='f37b53a21b19482b8dcac6c38505a50b',revision_number=1,rules=[SecurityGroupRule(063ae63e-8492-4e62-9b01-cd6855d71472),SecurityGroupRule(07b9348b-ca61-4d23-aaf5-1488609a36d2)],shared=False,stateful=True,updated_at=2022-09-25T01:03:47Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:48.039257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-29dc0ce8-d269-40ab-8eae-ff327562d55d tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (bfb86a56-b21b-42ad-94ac-a717aef8569c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:48.041170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-29dc0ce8-d269-40ab-8eae-ff327562d55d tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:47Z,description=,direction='egress',ethertype='IPv4',id=063ae63e-8492-4e62-9b01-cd6855d71472,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f37b53a21b19482b8dcac6c38505a50b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=bfb86a56-b21b-42ad-94ac-a717aef8569c,updated_at=2022-09-25T01:03:47Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:48.041791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-29dc0ce8-d269-40ab-8eae-ff327562d55d tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (063ae63e-8492-4e62-9b01-cd6855d71472), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:48.042668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-29dc0ce8-d269-40ab-8eae-ff327562d55d tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Security group rule updated ['bfb86a56-b21b-42ad-94ac-a717aef8569c'] Sep 25 01:03:48.044396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-29dc0ce8-d269-40ab-8eae-ff327562d55d tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:47Z,description=,direction='egress',ethertype='IPv6',id=07b9348b-ca61-4d23-aaf5-1488609a36d2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f37b53a21b19482b8dcac6c38505a50b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=bfb86a56-b21b-42ad-94ac-a717aef8569c,updated_at=2022-09-25T01:03:47Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:48.046188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-29dc0ce8-d269-40ab-8eae-ff327562d55d tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (07b9348b-ca61-4d23-aaf5-1488609a36d2), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:48.047063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-29dc0ce8-d269-40ab-8eae-ff327562d55d tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Security group rule updated ['bfb86a56-b21b-42ad-94ac-a717aef8569c'] Sep 25 01:03:48.049206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["f8e1e993-6abf-4cda-9087-69b4ee72064c","insert","qg-0feb7341-06",["set",[]],["map",[["attached-mac","fa:16:3e:b7:67:2f"],["iface-id","0feb7341-0637-4360-9832-808376ee9e2a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:03:48.087449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["f8e1e993-6abf-4cda-9087-69b4ee72064c","old",null,["set",[]],null],["","new","qg-0feb7341-06",38,["map",[["attached-mac","fa:16:3e:b7:67:2f"],["iface-id","0feb7341-0637-4360-9832-808376ee9e2a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:03:48.202352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:488 started Sep 25 01:03:48.205056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e117,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=931000000,duration_sec=990,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:48.206264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:03:48.206888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:488 - starting polling. Elapsed:0.005 Sep 25 01:03:48.209959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:48.215317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:488 - port information retrieved. Elapsed:0.013 Sep 25 01:03:48.215953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'41a4501b-2acb-4e3d-a37d-bedbcdc6c76d', '0feb7341-0637-4360-9832-808376ee9e2a', '2f0cdd80-0129-4756-a061-a2bfb559e884', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', 'd18a3c48-8be7-45c0-8641-dd3182b273bc', 'dc092d9f-c63d-420c-8856-ecb381597fd7', '312a0875-9d08-4c94-b6f3-3135500afa6a', 'de4727a2-569d-44c6-a53e-ecc89817f610', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '71ee88f3-d4ca-4676-ab1f-7494784204fa', '4a688d1f-1335-463f-b319-bcba153c442f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', '025c4caf-135a-4da4-9e95-24f950bedb8b', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92'}, 'added': {'2f0cdd80-0129-4756-a061-a2bfb559e884', '0feb7341-0637-4360-9832-808376ee9e2a'}, 'removed': set(), 'updated': {'0feb7341-0637-4360-9832-808376ee9e2a'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:03:48.216997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: WARNING neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:03:45Z,data_plane_status=None,description='',device_id='4b996018-6bbd-4ec4-b932-a040ccf832d9',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=2f0cdd80-0129-4756-a061-a2bfb559e884,mac_address=fa:16:3e:b2:6f:aa,name='',network_id=dbea2e08-a361-48c8-95fc-03b3fc326d51,numa_affinity_policy=,project_id='f37b53a21b19482b8dcac6c38505a50b',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(2f0cdd80-0129-4756-a061-a2bfb559e884),security_group_ids=set([]),status='DOWN',updated_at=2022-09-25T01:03:46Z) is not bound. Sep 25 01:03:48.217896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '0feb7341-0637-4360-9832-808376ee9e2a', 'device_id': '4b996018-6bbd-4ec4-b932-a040ccf832d9', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': '0feb7341-0637-4360-9832-808376ee9e2a', 'mac_address': 'fa:16:3e:b7:67:2f', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.219'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 01:03:48.223714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 2f0cdd80-0129-4756-a061-a2bfb559e884 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 01:03:48.224291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Device 2f0cdd80-0129-4756-a061-a2bfb559e884 not defined on plugin or binding failed Sep 25 01:03:48.225100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 0feb7341-0637-4360-9832-808376ee9e2a {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 01:03:48.225654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 0feb7341-0637-4360-9832-808376ee9e2a updated. Details: {'device': '0feb7341-0637-4360-9832-808376ee9e2a', 'device_id': '4b996018-6bbd-4ec4-b932-a040ccf832d9', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': '0feb7341-0637-4360-9832-808376ee9e2a', 'mac_address': 'fa:16:3e:b7:67:2f', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.219'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 25 01:03:48.226700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-0feb7341-06, col_values=(('tag', 2),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:03:48.227149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-0feb7341-06, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:03:48.227595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-0feb7341-06, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:03:48.237892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-0feb7341-06, col_values=(('other_config', {'net_uuid': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:03:48.250996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-93cefea6-4dae-45b1-9969-06177eb0dd74 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:48Z,description='',direction='ingress',ethertype='IPv4',id=aa546abb-eaaa-4d5a-9cd6-9fa4ef15eb54,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='f37b53a21b19482b8dcac6c38505a50b',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=bfb86a56-b21b-42ad-94ac-a717aef8569c,updated_at=2022-09-25T01:03:48Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:48.251395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-93cefea6-4dae-45b1-9969-06177eb0dd74 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (aa546abb-eaaa-4d5a-9cd6-9fa4ef15eb54), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:48.251744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-93cefea6-4dae-45b1-9969-06177eb0dd74 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Security group rule updated ['bfb86a56-b21b-42ad-94ac-a717aef8569c'] Sep 25 01:03:48.257549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e119,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 38}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:48.257894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:488 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.041 Sep 25 01:03:48.258685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing device filters for 2 new devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 25 01:03:48.259256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Preparing filters for devices {'2f0cdd80-0129-4756-a061-a2bfb559e884', '0feb7341-0637-4360-9832-808376ee9e2a'} Sep 25 01:03:48.261015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 01:03:48.261409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 01:03:48.267054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:03:48.355264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f35f35-56bb-45cd-acb1-0580f35d3d1d]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:03:48.356954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:488 - agent port security group processed in 0.140 Sep 25 01:03:48.357741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 0feb7341-0637-4360-9832-808376ee9e2a to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 01:03:48.493207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-515f02e5-7807-438f-8e33-a28f0bdba81b tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:48Z,description='',direction='ingress',ethertype='IPv4',id=0ec64e4e-e64f-4379-94f2-7732f4f966bd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f37b53a21b19482b8dcac6c38505a50b',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=bfb86a56-b21b-42ad-94ac-a717aef8569c,updated_at=2022-09-25T01:03:48Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:48.493969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-515f02e5-7807-438f-8e33-a28f0bdba81b tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (0ec64e4e-e64f-4379-94f2-7732f4f966bd), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:48.494725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-515f02e5-7807-438f-8e33-a28f0bdba81b tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Security group rule updated ['bfb86a56-b21b-42ad-94ac-a717aef8569c'] Sep 25 01:03:48.672134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['0feb7341-0637-4360-9832-808376ee9e2a'] and devices down [] completed. Sep 25 01:03:48.672777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:488 - ports processed. Elapsed:0.471 Sep 25 01:03:48.674020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:488 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 1, 'removed': 0}}. Elapsed:0.471 Sep 25 01:03:48.747554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Resource Port 0feb7341-0637-4360-9832-808376ee9e2a updated (revision_number 3->4). Old fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=0feb7341-0637-4360-9832-808376ee9e2a,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)], 'status': 'DOWN'} New fields: {'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=0feb7341-0637-4360-9832-808376ee9e2a,segment=NetworkSegment(8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c),segment_id=8ce8cc5e-c7c0-4ed0-855c-d3aeb61eab7c)], 'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:03:48.748371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c00c2c73-08d7-443c-8929-c4f85b465749 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (0feb7341-0637-4360-9832-808376ee9e2a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:49.116057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-68dd64d2-6dde-4088-ae2a-489c5e0465aa admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:03:48Z,description='Default security group',id=aafd16aa-0abe-4a4f-90f2-36d2202ff94a,is_default=True,name='default',project_id='24539ff7316f4afebd0bb6f5c2749d98',revision_number=1,rules=[SecurityGroupRule(75b02663-7476-4e59-962f-4e3f3941a8d6),SecurityGroupRule(9a2798ad-9b43-477e-8aff-407b7b928405),SecurityGroupRule(f3f2cef3-bdec-4003-9f3d-9cd6acdc6c9a),SecurityGroupRule(f8d527c3-565f-44bb-b5cc-612ca2efac20)],shared=False,stateful=True,updated_at=2022-09-25T01:03:48Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:49.117166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-68dd64d2-6dde-4088-ae2a-489c5e0465aa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (aafd16aa-0abe-4a4f-90f2-36d2202ff94a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:49.118029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-68dd64d2-6dde-4088-ae2a-489c5e0465aa admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:48Z,description=,direction='egress',ethertype='IPv4',id=75b02663-7476-4e59-962f-4e3f3941a8d6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='24539ff7316f4afebd0bb6f5c2749d98',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=aafd16aa-0abe-4a4f-90f2-36d2202ff94a,updated_at=2022-09-25T01:03:48Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:49.118584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-68dd64d2-6dde-4088-ae2a-489c5e0465aa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (75b02663-7476-4e59-962f-4e3f3941a8d6), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:49.119110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-68dd64d2-6dde-4088-ae2a-489c5e0465aa admin admin] Security group rule updated ['aafd16aa-0abe-4a4f-90f2-36d2202ff94a'] Sep 25 01:03:49.119964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-68dd64d2-6dde-4088-ae2a-489c5e0465aa admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:49Z,description=,direction='egress',ethertype='IPv6',id=9a2798ad-9b43-477e-8aff-407b7b928405,normalized_cidr=None,port_range_max=,port_range_min=,project_id='24539ff7316f4afebd0bb6f5c2749d98',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=aafd16aa-0abe-4a4f-90f2-36d2202ff94a,updated_at=2022-09-25T01:03:49Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:49.120658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-68dd64d2-6dde-4088-ae2a-489c5e0465aa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (9a2798ad-9b43-477e-8aff-407b7b928405), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:49.121398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-68dd64d2-6dde-4088-ae2a-489c5e0465aa admin admin] Security group rule updated ['aafd16aa-0abe-4a4f-90f2-36d2202ff94a'] Sep 25 01:03:49.122578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-68dd64d2-6dde-4088-ae2a-489c5e0465aa admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:49Z,description=,direction='ingress',ethertype='IPv6',id=f3f2cef3-bdec-4003-9f3d-9cd6acdc6c9a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='24539ff7316f4afebd0bb6f5c2749d98',protocol=,remote_address_group_id=,remote_group_id=aafd16aa-0abe-4a4f-90f2-36d2202ff94a,remote_ip_prefix=,revision_number=0,security_group_id=aafd16aa-0abe-4a4f-90f2-36d2202ff94a,updated_at=2022-09-25T01:03:49Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:49.123219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-68dd64d2-6dde-4088-ae2a-489c5e0465aa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f3f2cef3-bdec-4003-9f3d-9cd6acdc6c9a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:49.125011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-68dd64d2-6dde-4088-ae2a-489c5e0465aa admin admin] Security group rule updated ['aafd16aa-0abe-4a4f-90f2-36d2202ff94a'] Sep 25 01:03:49.126059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-68dd64d2-6dde-4088-ae2a-489c5e0465aa admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:48Z,description=,direction='ingress',ethertype='IPv4',id=f8d527c3-565f-44bb-b5cc-612ca2efac20,normalized_cidr=None,port_range_max=,port_range_min=,project_id='24539ff7316f4afebd0bb6f5c2749d98',protocol=,remote_address_group_id=,remote_group_id=aafd16aa-0abe-4a4f-90f2-36d2202ff94a,remote_ip_prefix=,revision_number=0,security_group_id=aafd16aa-0abe-4a4f-90f2-36d2202ff94a,updated_at=2022-09-25T01:03:48Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:49.126895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-68dd64d2-6dde-4088-ae2a-489c5e0465aa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f8d527c3-565f-44bb-b5cc-612ca2efac20), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:49.127537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-68dd64d2-6dde-4088-ae2a-489c5e0465aa admin admin] Security group rule updated ['aafd16aa-0abe-4a4f-90f2-36d2202ff94a'] Sep 25 01:03:49.300203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0189b9de-7234-42c7-93d5-f1c11219e77a tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:03:48Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=84c0f85e-de10-4d63-ae1d-deab86b97883,mac_address=fa:16:3e:3f:2d:61,name='',network_id=62195cd6-54fa-4e24-9d47-ae0de6356ac2,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(84c0f85e-de10-4d63-ae1d-deab86b97883),security_group_ids=set([]),status='N/A',updated_at=2022-09-25T01:03:48Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:49.300743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0189b9de-7234-42c7-93d5-f1c11219e77a tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (84c0f85e-de10-4d63-ae1d-deab86b97883), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:49.460602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c194179f-225b-4203-800d-f932bed85be9 admin admin] Resource SecurityGroup deleted: aafd16aa-0abe-4a4f-90f2-36d2202ff94a {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:49.462351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c194179f-225b-4203-800d-f932bed85be9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (aafd16aa-0abe-4a4f-90f2-36d2202ff94a), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:49.463622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c194179f-225b-4203-800d-f932bed85be9 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('aafd16aa-0abe-4a4f-90f2-36d2202ff94a',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:03:49.494971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c194179f-225b-4203-800d-f932bed85be9 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('aafd16aa-0abe-4a4f-90f2-36d2202ff94a',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:03:49.505454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c194179f-225b-4203-800d-f932bed85be9 admin admin] Resource SecurityGroupRule deleted: 75b02663-7476-4e59-962f-4e3f3941a8d6 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:49.506329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c194179f-225b-4203-800d-f932bed85be9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (75b02663-7476-4e59-962f-4e3f3941a8d6), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:49.507428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c194179f-225b-4203-800d-f932bed85be9 admin admin] Security group rule updated ['aafd16aa-0abe-4a4f-90f2-36d2202ff94a'] Sep 25 01:03:49.508655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c194179f-225b-4203-800d-f932bed85be9 admin admin] Resource SecurityGroupRule deleted: 9a2798ad-9b43-477e-8aff-407b7b928405 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:49.509242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c194179f-225b-4203-800d-f932bed85be9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (9a2798ad-9b43-477e-8aff-407b7b928405), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:49.509780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c194179f-225b-4203-800d-f932bed85be9 admin admin] Security group rule updated ['aafd16aa-0abe-4a4f-90f2-36d2202ff94a'] Sep 25 01:03:49.510397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c194179f-225b-4203-800d-f932bed85be9 admin admin] Resource SecurityGroupRule deleted: f3f2cef3-bdec-4003-9f3d-9cd6acdc6c9a {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:49.510954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c194179f-225b-4203-800d-f932bed85be9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f3f2cef3-bdec-4003-9f3d-9cd6acdc6c9a), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:49.511485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c194179f-225b-4203-800d-f932bed85be9 admin admin] Security group rule updated ['aafd16aa-0abe-4a4f-90f2-36d2202ff94a'] Sep 25 01:03:49.512150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c194179f-225b-4203-800d-f932bed85be9 admin admin] Resource SecurityGroupRule deleted: f8d527c3-565f-44bb-b5cc-612ca2efac20 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:49.512706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c194179f-225b-4203-800d-f932bed85be9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f8d527c3-565f-44bb-b5cc-612ca2efac20), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:49.513228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c194179f-225b-4203-800d-f932bed85be9 admin admin] Security group rule updated ['aafd16aa-0abe-4a4f-90f2-36d2202ff94a'] Sep 25 01:03:49.961997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0189b9de-7234-42c7-93d5-f1c11219e77a tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Resource Port 84c0f85e-de10-4d63-ae1d-deab86b97883 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'db59aa21-2a25-4361-a747-7d670cbfd031'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:03:49.963042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0189b9de-7234-42c7-93d5-f1c11219e77a tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (84c0f85e-de10-4d63-ae1d-deab86b97883), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:50.153558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2174d174-f394-401d-93f4-af08f6a34e24 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:03:49Z,description='Default security group',id=f7ed1279-3dab-4416-a15e-8fab9cbfb20a,is_default=True,name='default',project_id='d6cca8ceef2e4221ace15fb7b996b6aa',revision_number=1,rules=[SecurityGroupRule(1128bcf1-7bb8-4703-b6ac-a506491c323c),SecurityGroupRule(328f4c45-45b9-4de8-b20b-b4fd7da48cbd),SecurityGroupRule(5557fa1e-7d6c-4d66-a58c-45845c494cd0),SecurityGroupRule(e40591fe-af1e-4158-8412-c6bb9d5f4e12)],shared=False,stateful=True,updated_at=2022-09-25T01:03:49Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:50.154953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2174d174-f394-401d-93f4-af08f6a34e24 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (f7ed1279-3dab-4416-a15e-8fab9cbfb20a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:50.156688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2174d174-f394-401d-93f4-af08f6a34e24 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:49Z,description=,direction='ingress',ethertype='IPv4',id=1128bcf1-7bb8-4703-b6ac-a506491c323c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d6cca8ceef2e4221ace15fb7b996b6aa',protocol=,remote_address_group_id=,remote_group_id=f7ed1279-3dab-4416-a15e-8fab9cbfb20a,remote_ip_prefix=,revision_number=0,security_group_id=f7ed1279-3dab-4416-a15e-8fab9cbfb20a,updated_at=2022-09-25T01:03:49Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:50.171855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2174d174-f394-401d-93f4-af08f6a34e24 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (1128bcf1-7bb8-4703-b6ac-a506491c323c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:50.172696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2174d174-f394-401d-93f4-af08f6a34e24 admin admin] Security group rule updated ['f7ed1279-3dab-4416-a15e-8fab9cbfb20a'] Sep 25 01:03:50.173515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2174d174-f394-401d-93f4-af08f6a34e24 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:50Z,description=,direction='ingress',ethertype='IPv6',id=328f4c45-45b9-4de8-b20b-b4fd7da48cbd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d6cca8ceef2e4221ace15fb7b996b6aa',protocol=,remote_address_group_id=,remote_group_id=f7ed1279-3dab-4416-a15e-8fab9cbfb20a,remote_ip_prefix=,revision_number=0,security_group_id=f7ed1279-3dab-4416-a15e-8fab9cbfb20a,updated_at=2022-09-25T01:03:50Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:50.173894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2174d174-f394-401d-93f4-af08f6a34e24 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (328f4c45-45b9-4de8-b20b-b4fd7da48cbd), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:50.174253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2174d174-f394-401d-93f4-af08f6a34e24 admin admin] Security group rule updated ['f7ed1279-3dab-4416-a15e-8fab9cbfb20a'] Sep 25 01:03:50.175991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2174d174-f394-401d-93f4-af08f6a34e24 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:50Z,description=,direction='egress',ethertype='IPv6',id=5557fa1e-7d6c-4d66-a58c-45845c494cd0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d6cca8ceef2e4221ace15fb7b996b6aa',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f7ed1279-3dab-4416-a15e-8fab9cbfb20a,updated_at=2022-09-25T01:03:50Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:50.176509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2174d174-f394-401d-93f4-af08f6a34e24 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (5557fa1e-7d6c-4d66-a58c-45845c494cd0), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:50.176853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2174d174-f394-401d-93f4-af08f6a34e24 admin admin] Security group rule updated ['f7ed1279-3dab-4416-a15e-8fab9cbfb20a'] Sep 25 01:03:50.177579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2174d174-f394-401d-93f4-af08f6a34e24 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:49Z,description=,direction='egress',ethertype='IPv4',id=e40591fe-af1e-4158-8412-c6bb9d5f4e12,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d6cca8ceef2e4221ace15fb7b996b6aa',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f7ed1279-3dab-4416-a15e-8fab9cbfb20a,updated_at=2022-09-25T01:03:49Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:50.178148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2174d174-f394-401d-93f4-af08f6a34e24 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (e40591fe-af1e-4158-8412-c6bb9d5f4e12), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:50.178648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2174d174-f394-401d-93f4-af08f6a34e24 admin admin] Security group rule updated ['f7ed1279-3dab-4416-a15e-8fab9cbfb20a'] Sep 25 01:03:50.204916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:489 started Sep 25 01:03:50.212021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e11b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=935000000,duration_sec=992,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:50.214537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:03:50.214929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:489 - starting polling. Elapsed:0.010 Sep 25 01:03:50.222074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:50.244783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:489 - port information retrieved. Elapsed:0.040 Sep 25 01:03:50.245308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'41a4501b-2acb-4e3d-a37d-bedbcdc6c76d', '0feb7341-0637-4360-9832-808376ee9e2a', '2f0cdd80-0129-4756-a061-a2bfb559e884', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', 'd18a3c48-8be7-45c0-8641-dd3182b273bc', 'dc092d9f-c63d-420c-8856-ecb381597fd7', '312a0875-9d08-4c94-b6f3-3135500afa6a', 'de4727a2-569d-44c6-a53e-ecc89817f610', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '71ee88f3-d4ca-4676-ab1f-7494784204fa', '4a688d1f-1335-463f-b319-bcba153c442f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', '025c4caf-135a-4da4-9e95-24f950bedb8b', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92'}, 'added': set(), 'removed': set(), 'updated': {'0feb7341-0637-4360-9832-808376ee9e2a'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:03:50.246299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '0feb7341-0637-4360-9832-808376ee9e2a', 'device_id': '4b996018-6bbd-4ec4-b932-a040ccf832d9', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': '0feb7341-0637-4360-9832-808376ee9e2a', 'mac_address': 'fa:16:3e:b7:67:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.219'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 01:03:50.256185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 0feb7341-0637-4360-9832-808376ee9e2a {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 01:03:50.256185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 0feb7341-0637-4360-9832-808376ee9e2a updated. Details: {'device': '0feb7341-0637-4360-9832-808376ee9e2a', 'device_id': '4b996018-6bbd-4ec4-b932-a040ccf832d9', 'network_id': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'port_id': '0feb7341-0637-4360-9832-808376ee9e2a', 'mac_address': 'fa:16:3e:b7:67:2f', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd01a90bc-22e7-43bc-8649-e22859dad8e0', 'ip_address': '172.37.1.219'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 25 01:03:50.257559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-0feb7341-06, col_values=(('tag', 2),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:03:50.258318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-0feb7341-06, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:03:50.259894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-0feb7341-06, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:03:50.260724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 01:03:50.263531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-0feb7341-06, col_values=(('other_config', {'net_uuid': '62195cd6-54fa-4e24-9d47-ae0de6356ac2', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:03:50.265378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 25 01:03:50.277019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e11d,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 38}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:50.278267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:489 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.032 Sep 25 01:03:50.278876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refreshing firewall for 1 devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 25 01:03:50.279381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refresh firewall rules Sep 25 01:03:50.281502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 01:03:50.281975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 01:03:50.290663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:03:50.352338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cbad0c-224b-43bb-b94d-e6d56a9463e8]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:03:50.352974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:489 - agent port security group processed in 0.107 Sep 25 01:03:50.353812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 0feb7341-0637-4360-9832-808376ee9e2a to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 01:03:50.573520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-31b8ae76-9083-466f-9e28-0f9c37c20e64 admin admin] Resource SecurityGroup deleted: f7ed1279-3dab-4416-a15e-8fab9cbfb20a {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:50.574391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-31b8ae76-9083-466f-9e28-0f9c37c20e64 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (f7ed1279-3dab-4416-a15e-8fab9cbfb20a), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:50.575530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31b8ae76-9083-466f-9e28-0f9c37c20e64 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('f7ed1279-3dab-4416-a15e-8fab9cbfb20a',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:03:50.610312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['0feb7341-0637-4360-9832-808376ee9e2a'] and devices down [] completed. Sep 25 01:03:50.610839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:489 - ports processed. Elapsed:0.406 Sep 25 01:03:50.611396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:489 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.407 Sep 25 01:03:50.614786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-31b8ae76-9083-466f-9e28-0f9c37c20e64 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('f7ed1279-3dab-4416-a15e-8fab9cbfb20a',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:03:50.615595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-31b8ae76-9083-466f-9e28-0f9c37c20e64 admin admin] Resource SecurityGroupRule deleted: 1128bcf1-7bb8-4703-b6ac-a506491c323c {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:50.616196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-31b8ae76-9083-466f-9e28-0f9c37c20e64 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (1128bcf1-7bb8-4703-b6ac-a506491c323c), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:50.616761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-31b8ae76-9083-466f-9e28-0f9c37c20e64 admin admin] Security group rule updated ['f7ed1279-3dab-4416-a15e-8fab9cbfb20a'] Sep 25 01:03:50.617476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-31b8ae76-9083-466f-9e28-0f9c37c20e64 admin admin] Resource SecurityGroupRule deleted: 328f4c45-45b9-4de8-b20b-b4fd7da48cbd {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:50.618321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-31b8ae76-9083-466f-9e28-0f9c37c20e64 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (328f4c45-45b9-4de8-b20b-b4fd7da48cbd), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:50.618855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-31b8ae76-9083-466f-9e28-0f9c37c20e64 admin admin] Security group rule updated ['f7ed1279-3dab-4416-a15e-8fab9cbfb20a'] Sep 25 01:03:50.619693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-31b8ae76-9083-466f-9e28-0f9c37c20e64 admin admin] Resource SecurityGroupRule deleted: 5557fa1e-7d6c-4d66-a58c-45845c494cd0 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:50.620485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-31b8ae76-9083-466f-9e28-0f9c37c20e64 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (5557fa1e-7d6c-4d66-a58c-45845c494cd0), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:50.621200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-31b8ae76-9083-466f-9e28-0f9c37c20e64 admin admin] Security group rule updated ['f7ed1279-3dab-4416-a15e-8fab9cbfb20a'] Sep 25 01:03:50.621929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-31b8ae76-9083-466f-9e28-0f9c37c20e64 admin admin] Resource SecurityGroupRule deleted: e40591fe-af1e-4158-8412-c6bb9d5f4e12 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:50.622646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-31b8ae76-9083-466f-9e28-0f9c37c20e64 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (e40591fe-af1e-4158-8412-c6bb9d5f4e12), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:50.623404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-31b8ae76-9083-466f-9e28-0f9c37c20e64 admin admin] Security group rule updated ['f7ed1279-3dab-4416-a15e-8fab9cbfb20a'] Sep 25 01:03:51.226142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b86f23e2-9d35-4cbc-b0ef-bdb3414bea0f None None] Resource Port 2f0cdd80-0129-4756-a061-a2bfb559e884 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=2f0cdd80-0129-4756-a061-a2bfb559e884,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=2f0cdd80-0129-4756-a061-a2bfb559e884,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:03:51.228410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b86f23e2-9d35-4cbc-b0ef-bdb3414bea0f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (2f0cdd80-0129-4756-a061-a2bfb559e884), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:51.559210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b86f23e2-9d35-4cbc-b0ef-bdb3414bea0f None None] Resource Port 2f0cdd80-0129-4756-a061-a2bfb559e884 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=2f0cdd80-0129-4756-a061-a2bfb559e884,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=2f0cdd80-0129-4756-a061-a2bfb559e884,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=2f0cdd80-0129-4756-a061-a2bfb559e884,segment=NetworkSegment(ed5ec111-24e0-4aad-b5c7-8fcadf6e28a3),segment_id=ed5ec111-24e0-4aad-b5c7-8fcadf6e28a3)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:03:51.561457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b86f23e2-9d35-4cbc-b0ef-bdb3414bea0f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (2f0cdd80-0129-4756-a061-a2bfb559e884), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:51.871241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2a254bab-32f0-4a45-8892-440a5c778cc3 None None] Resource Port 2f0cdd80-0129-4756-a061-a2bfb559e884 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:03:51.871704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2a254bab-32f0-4a45-8892-440a5c778cc3 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (2f0cdd80-0129-4756-a061-a2bfb559e884), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:52.205840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:490 started Sep 25 01:03:52.209840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e11f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=935000000,duration_sec=994,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:52.210782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:03:52.211295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:490 - starting polling. Elapsed:0.006 Sep 25 01:03:52.215760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:52.222410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:490 - port information retrieved. Elapsed:0.016 Sep 25 01:03:52.223173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'41a4501b-2acb-4e3d-a37d-bedbcdc6c76d', '0feb7341-0637-4360-9832-808376ee9e2a', '2f0cdd80-0129-4756-a061-a2bfb559e884', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', 'd18a3c48-8be7-45c0-8641-dd3182b273bc', 'dc092d9f-c63d-420c-8856-ecb381597fd7', '312a0875-9d08-4c94-b6f3-3135500afa6a', 'de4727a2-569d-44c6-a53e-ecc89817f610', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '71ee88f3-d4ca-4676-ab1f-7494784204fa', '4a688d1f-1335-463f-b319-bcba153c442f', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', 'd2abc674-9be0-4d84-bba8-aeef142e4a64', '025c4caf-135a-4da4-9e95-24f950bedb8b', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92'}, 'added': set(), 'removed': set(), 'updated': {'2f0cdd80-0129-4756-a061-a2bfb559e884'}, 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:03:52.224024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Returning: {'device': '2f0cdd80-0129-4756-a061-a2bfb559e884', 'device_id': '4b996018-6bbd-4ec4-b932-a040ccf832d9', 'network_id': 'dbea2e08-a361-48c8-95fc-03b3fc326d51', 'port_id': '2f0cdd80-0129-4756-a061-a2bfb559e884', 'mac_address': 'fa:16:3e:b2:6f:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 60, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2e1050b6-9f20-4f3d-a5dc-be57c6013353', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=107261) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 25 01:03:52.229411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing port: 2f0cdd80-0129-4756-a061-a2bfb559e884 {{(pid=107261) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 25 01:03:52.231631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 2f0cdd80-0129-4756-a061-a2bfb559e884 updated. Details: {'device': '2f0cdd80-0129-4756-a061-a2bfb559e884', 'device_id': '4b996018-6bbd-4ec4-b932-a040ccf832d9', 'network_id': 'dbea2e08-a361-48c8-95fc-03b3fc326d51', 'port_id': '2f0cdd80-0129-4756-a061-a2bfb559e884', 'mac_address': 'fa:16:3e:b2:6f:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 60, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '2e1050b6-9f20-4f3d-a5dc-be57c6013353', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 14} Sep 25 01:03:52.233036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-2f0cdd80-01, col_values=(('tag', 14),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:03:52.234473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-2f0cdd80-01, column=vlan_mode) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:03:52.234871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-2f0cdd80-01, column=trunks) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:03:52.245807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-2f0cdd80-01, col_values=(('other_config', {'net_uuid': 'dbea2e08-a361-48c8-95fc-03b3fc326d51', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '14', 'segmentation_id': '60'}),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:03:52.277914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e121,OFPFlowMod(buffer_id=4294967295,command=4,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 37}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:52.283146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:490 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.059 Sep 25 01:03:52.284566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refreshing firewall for 1 devices {{(pid=107261) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 25 01:03:52.285249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Refresh firewall rules Sep 25 01:03:52.287187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information for ports dict_keys([]) {{(pid=107261) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 25 01:03:52.287720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Update security group information {{(pid=107261) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 25 01:03:52.298706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 2 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:03:52.392319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5805ad68-95a2-4952-af56-0fedef0dbfab]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:03:52.395339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:490 - agent port security group processed in 0.171 Sep 25 01:03:52.399977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Setting status for 2f0cdd80-0129-4756-a061-a2bfb559e884 to UP {{(pid=107261) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 25 01:03:52.626683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up ['2f0cdd80-0129-4756-a061-a2bfb559e884'] and devices down [] completed. Sep 25 01:03:52.627940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:490 - ports processed. Elapsed:0.422 Sep 25 01:03:52.630633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:490 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.423 Sep 25 01:03:54.208894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:491 started Sep 25 01:03:54.211621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e123,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=937000000,duration_sec=996,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:54.212162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:03:54.212568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:491 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:03:55.559880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c7e583ac-3e5c-45ee-872e-751fcc7530a0 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:03:55Z,data_plane_status=None,description='',device_id='1de127ae-8886-4d15-a6be-7b68902ccde8',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=c71c9659-825c-4f3d-b945-2c964a1f67a7,mac_address=fa:16:3e:7b:8f:44,name='',network_id=dbea2e08-a361-48c8-95fc-03b3fc326d51,numa_affinity_policy=,project_id='f37b53a21b19482b8dcac6c38505a50b',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(c71c9659-825c-4f3d-b945-2c964a1f67a7),security_group_ids=set([bfb86a56-b21b-42ad-94ac-a717aef8569c]),status='DOWN',updated_at=2022-09-25T01:03:55Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:55.560632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c7e583ac-3e5c-45ee-872e-751fcc7530a0 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (c71c9659-825c-4f3d-b945-2c964a1f67a7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:55.561173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c7e583ac-3e5c-45ee-872e-751fcc7530a0 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Security group member updated {'bfb86a56-b21b-42ad-94ac-a717aef8569c'} Sep 25 01:03:56.209603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:492 started Sep 25 01:03:56.212761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e125,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=938000000,duration_sec=998,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:56.213785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:03:56.214639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:492 - starting polling. Elapsed:0.005 Sep 25 01:03:56.219186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:56.224458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:492 - port information retrieved. Elapsed:0.015 Sep 25 01:03:56.224918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:492 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Sep 25 01:03:56.562756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c2246fa1-761c-4c60-b93f-311e0b34ab49 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:03:56Z,description='Default security group',id=1f076af5-308f-40f5-b77c-af020e85ce8c,is_default=True,name='default',project_id='a4c77d3ed756497782dfc2b6a39ead1d',revision_number=1,rules=[SecurityGroupRule(006974af-d4fe-4cb4-9f5c-41506e896801),SecurityGroupRule(427abfa6-b1ac-4926-a1d3-c65359a792d7),SecurityGroupRule(c760c54a-b2f0-4b4b-8291-be57e6b6fe77),SecurityGroupRule(ff906cca-1bbe-410d-be04-b16014252dcc)],shared=False,stateful=True,updated_at=2022-09-25T01:03:56Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:56.563845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c2246fa1-761c-4c60-b93f-311e0b34ab49 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (1f076af5-308f-40f5-b77c-af020e85ce8c), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:56.565140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c2246fa1-761c-4c60-b93f-311e0b34ab49 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:56Z,description=,direction='ingress',ethertype='IPv4',id=006974af-d4fe-4cb4-9f5c-41506e896801,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a4c77d3ed756497782dfc2b6a39ead1d',protocol=,remote_address_group_id=,remote_group_id=1f076af5-308f-40f5-b77c-af020e85ce8c,remote_ip_prefix=,revision_number=0,security_group_id=1f076af5-308f-40f5-b77c-af020e85ce8c,updated_at=2022-09-25T01:03:56Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:56.566261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c2246fa1-761c-4c60-b93f-311e0b34ab49 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (006974af-d4fe-4cb4-9f5c-41506e896801), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:56.567133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c2246fa1-761c-4c60-b93f-311e0b34ab49 admin admin] Security group rule updated ['1f076af5-308f-40f5-b77c-af020e85ce8c'] Sep 25 01:03:56.568787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c2246fa1-761c-4c60-b93f-311e0b34ab49 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:56Z,description=,direction='ingress',ethertype='IPv6',id=427abfa6-b1ac-4926-a1d3-c65359a792d7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a4c77d3ed756497782dfc2b6a39ead1d',protocol=,remote_address_group_id=,remote_group_id=1f076af5-308f-40f5-b77c-af020e85ce8c,remote_ip_prefix=,revision_number=0,security_group_id=1f076af5-308f-40f5-b77c-af020e85ce8c,updated_at=2022-09-25T01:03:56Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:56.569737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c2246fa1-761c-4c60-b93f-311e0b34ab49 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (427abfa6-b1ac-4926-a1d3-c65359a792d7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:56.570668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c2246fa1-761c-4c60-b93f-311e0b34ab49 admin admin] Security group rule updated ['1f076af5-308f-40f5-b77c-af020e85ce8c'] Sep 25 01:03:56.572044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c2246fa1-761c-4c60-b93f-311e0b34ab49 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:56Z,description=,direction='egress',ethertype='IPv6',id=c760c54a-b2f0-4b4b-8291-be57e6b6fe77,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a4c77d3ed756497782dfc2b6a39ead1d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1f076af5-308f-40f5-b77c-af020e85ce8c,updated_at=2022-09-25T01:03:56Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:56.572779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c2246fa1-761c-4c60-b93f-311e0b34ab49 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (c760c54a-b2f0-4b4b-8291-be57e6b6fe77), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:56.573587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c2246fa1-761c-4c60-b93f-311e0b34ab49 admin admin] Security group rule updated ['1f076af5-308f-40f5-b77c-af020e85ce8c'] Sep 25 01:03:56.574968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c2246fa1-761c-4c60-b93f-311e0b34ab49 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:56Z,description=,direction='egress',ethertype='IPv4',id=ff906cca-1bbe-410d-be04-b16014252dcc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a4c77d3ed756497782dfc2b6a39ead1d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1f076af5-308f-40f5-b77c-af020e85ce8c,updated_at=2022-09-25T01:03:56Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:56.575926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c2246fa1-761c-4c60-b93f-311e0b34ab49 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (ff906cca-1bbe-410d-be04-b16014252dcc), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:56.576788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c2246fa1-761c-4c60-b93f-311e0b34ab49 admin admin] Security group rule updated ['1f076af5-308f-40f5-b77c-af020e85ce8c'] Sep 25 01:03:56.724807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8ac7e33e-ed8a-4074-bb22-8652e26cd7b1 admin admin] Resource SecurityGroup deleted: 1f076af5-308f-40f5-b77c-af020e85ce8c {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:56.725202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8ac7e33e-ed8a-4074-bb22-8652e26cd7b1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (1f076af5-308f-40f5-b77c-af020e85ce8c), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:56.725734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ac7e33e-ed8a-4074-bb22-8652e26cd7b1 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('1f076af5-308f-40f5-b77c-af020e85ce8c',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:03:56.748925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8ac7e33e-ed8a-4074-bb22-8652e26cd7b1 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('1f076af5-308f-40f5-b77c-af020e85ce8c',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:03:56.749482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8ac7e33e-ed8a-4074-bb22-8652e26cd7b1 admin admin] Resource SecurityGroupRule deleted: 006974af-d4fe-4cb4-9f5c-41506e896801 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:56.750235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8ac7e33e-ed8a-4074-bb22-8652e26cd7b1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (006974af-d4fe-4cb4-9f5c-41506e896801), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:56.750586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8ac7e33e-ed8a-4074-bb22-8652e26cd7b1 admin admin] Security group rule updated ['1f076af5-308f-40f5-b77c-af020e85ce8c'] Sep 25 01:03:56.751129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8ac7e33e-ed8a-4074-bb22-8652e26cd7b1 admin admin] Resource SecurityGroupRule deleted: 427abfa6-b1ac-4926-a1d3-c65359a792d7 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:56.751329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8ac7e33e-ed8a-4074-bb22-8652e26cd7b1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (427abfa6-b1ac-4926-a1d3-c65359a792d7), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:56.751670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8ac7e33e-ed8a-4074-bb22-8652e26cd7b1 admin admin] Security group rule updated ['1f076af5-308f-40f5-b77c-af020e85ce8c'] Sep 25 01:03:56.752605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8ac7e33e-ed8a-4074-bb22-8652e26cd7b1 admin admin] Resource SecurityGroupRule deleted: c760c54a-b2f0-4b4b-8291-be57e6b6fe77 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:56.753229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8ac7e33e-ed8a-4074-bb22-8652e26cd7b1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (c760c54a-b2f0-4b4b-8291-be57e6b6fe77), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:56.753618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8ac7e33e-ed8a-4074-bb22-8652e26cd7b1 admin admin] Security group rule updated ['1f076af5-308f-40f5-b77c-af020e85ce8c'] Sep 25 01:03:56.754008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-8ac7e33e-ed8a-4074-bb22-8652e26cd7b1 admin admin] Resource SecurityGroupRule deleted: ff906cca-1bbe-410d-be04-b16014252dcc {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:56.754519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-8ac7e33e-ed8a-4074-bb22-8652e26cd7b1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (ff906cca-1bbe-410d-be04-b16014252dcc), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:56.754743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-8ac7e33e-ed8a-4074-bb22-8652e26cd7b1 admin admin] Security group rule updated ['1f076af5-308f-40f5-b77c-af020e85ce8c'] Sep 25 01:03:57.264551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fdeb29e2-9b94-4921-81a0-29e051e3d6ad admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:03:57Z,description='Default security group',id=d6c28311-4eb1-4673-9580-0ea21daf8566,is_default=True,name='default',project_id='ce04fef56605480eb8c6aca09c3a82f2',revision_number=1,rules=[SecurityGroupRule(66ee72b9-f97c-4cf4-94ce-8a25a24c5e97),SecurityGroupRule(8a82cba3-a464-4ecf-96db-ed56f95ce4d9),SecurityGroupRule(9b67e561-73c1-4878-9340-95c1a65b48ed),SecurityGroupRule(d8078c48-e048-4a2f-8311-470a0727b4ae)],shared=False,stateful=True,updated_at=2022-09-25T01:03:57Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:57.265091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fdeb29e2-9b94-4921-81a0-29e051e3d6ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (d6c28311-4eb1-4673-9580-0ea21daf8566), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:57.266484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fdeb29e2-9b94-4921-81a0-29e051e3d6ad admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:57Z,description=,direction='ingress',ethertype='IPv4',id=66ee72b9-f97c-4cf4-94ce-8a25a24c5e97,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ce04fef56605480eb8c6aca09c3a82f2',protocol=,remote_address_group_id=,remote_group_id=d6c28311-4eb1-4673-9580-0ea21daf8566,remote_ip_prefix=,revision_number=0,security_group_id=d6c28311-4eb1-4673-9580-0ea21daf8566,updated_at=2022-09-25T01:03:57Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:57.267021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fdeb29e2-9b94-4921-81a0-29e051e3d6ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (66ee72b9-f97c-4cf4-94ce-8a25a24c5e97), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:57.267559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-fdeb29e2-9b94-4921-81a0-29e051e3d6ad admin admin] Security group rule updated ['d6c28311-4eb1-4673-9580-0ea21daf8566'] Sep 25 01:03:57.269079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fdeb29e2-9b94-4921-81a0-29e051e3d6ad admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:57Z,description=,direction='egress',ethertype='IPv4',id=8a82cba3-a464-4ecf-96db-ed56f95ce4d9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ce04fef56605480eb8c6aca09c3a82f2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d6c28311-4eb1-4673-9580-0ea21daf8566,updated_at=2022-09-25T01:03:57Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:57.269649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fdeb29e2-9b94-4921-81a0-29e051e3d6ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (8a82cba3-a464-4ecf-96db-ed56f95ce4d9), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:57.270135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-fdeb29e2-9b94-4921-81a0-29e051e3d6ad admin admin] Security group rule updated ['d6c28311-4eb1-4673-9580-0ea21daf8566'] Sep 25 01:03:57.270963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fdeb29e2-9b94-4921-81a0-29e051e3d6ad admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:57Z,description=,direction='egress',ethertype='IPv6',id=9b67e561-73c1-4878-9340-95c1a65b48ed,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ce04fef56605480eb8c6aca09c3a82f2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d6c28311-4eb1-4673-9580-0ea21daf8566,updated_at=2022-09-25T01:03:57Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:57.271513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fdeb29e2-9b94-4921-81a0-29e051e3d6ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (9b67e561-73c1-4878-9340-95c1a65b48ed), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:57.271997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-fdeb29e2-9b94-4921-81a0-29e051e3d6ad admin admin] Security group rule updated ['d6c28311-4eb1-4673-9580-0ea21daf8566'] Sep 25 01:03:57.272829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-fdeb29e2-9b94-4921-81a0-29e051e3d6ad admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:03:57Z,description=,direction='ingress',ethertype='IPv6',id=d8078c48-e048-4a2f-8311-470a0727b4ae,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ce04fef56605480eb8c6aca09c3a82f2',protocol=,remote_address_group_id=,remote_group_id=d6c28311-4eb1-4673-9580-0ea21daf8566,remote_ip_prefix=,revision_number=0,security_group_id=d6c28311-4eb1-4673-9580-0ea21daf8566,updated_at=2022-09-25T01:03:57Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:03:57.273455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-fdeb29e2-9b94-4921-81a0-29e051e3d6ad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (d8078c48-e048-4a2f-8311-470a0727b4ae), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:57.274007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-fdeb29e2-9b94-4921-81a0-29e051e3d6ad admin admin] Security group rule updated ['d6c28311-4eb1-4673-9580-0ea21daf8566'] Sep 25 01:03:57.442205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-523b9d69-1a47-41c6-a18d-d2a6d6b57837 admin admin] Resource SecurityGroup deleted: d6c28311-4eb1-4673-9580-0ea21daf8566 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:57.442718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-523b9d69-1a47-41c6-a18d-d2a6d6b57837 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (d6c28311-4eb1-4673-9580-0ea21daf8566), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:57.443252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-523b9d69-1a47-41c6-a18d-d2a6d6b57837 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('d6c28311-4eb1-4673-9580-0ea21daf8566',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:03:57.464391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-523b9d69-1a47-41c6-a18d-d2a6d6b57837 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('d6c28311-4eb1-4673-9580-0ea21daf8566',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:03:57.464972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-523b9d69-1a47-41c6-a18d-d2a6d6b57837 admin admin] Resource SecurityGroupRule deleted: 66ee72b9-f97c-4cf4-94ce-8a25a24c5e97 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:57.465557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-523b9d69-1a47-41c6-a18d-d2a6d6b57837 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (66ee72b9-f97c-4cf4-94ce-8a25a24c5e97), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:57.465956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-523b9d69-1a47-41c6-a18d-d2a6d6b57837 admin admin] Security group rule updated ['d6c28311-4eb1-4673-9580-0ea21daf8566'] Sep 25 01:03:57.466399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-523b9d69-1a47-41c6-a18d-d2a6d6b57837 admin admin] Resource SecurityGroupRule deleted: 8a82cba3-a464-4ecf-96db-ed56f95ce4d9 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:57.466914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-523b9d69-1a47-41c6-a18d-d2a6d6b57837 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (8a82cba3-a464-4ecf-96db-ed56f95ce4d9), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:57.467314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-523b9d69-1a47-41c6-a18d-d2a6d6b57837 admin admin] Security group rule updated ['d6c28311-4eb1-4673-9580-0ea21daf8566'] Sep 25 01:03:57.467702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-523b9d69-1a47-41c6-a18d-d2a6d6b57837 admin admin] Resource SecurityGroupRule deleted: 9b67e561-73c1-4878-9340-95c1a65b48ed {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:57.468282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-523b9d69-1a47-41c6-a18d-d2a6d6b57837 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (9b67e561-73c1-4878-9340-95c1a65b48ed), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:57.468890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-523b9d69-1a47-41c6-a18d-d2a6d6b57837 admin admin] Security group rule updated ['d6c28311-4eb1-4673-9580-0ea21daf8566'] Sep 25 01:03:57.469478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-523b9d69-1a47-41c6-a18d-d2a6d6b57837 admin admin] Resource SecurityGroupRule deleted: d8078c48-e048-4a2f-8311-470a0727b4ae {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:03:57.470016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-523b9d69-1a47-41c6-a18d-d2a6d6b57837 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (d8078c48-e048-4a2f-8311-470a0727b4ae), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:57.470409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-523b9d69-1a47-41c6-a18d-d2a6d6b57837 admin admin] Security group rule updated ['d6c28311-4eb1-4673-9580-0ea21daf8566'] Sep 25 01:03:58.211563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:493 started Sep 25 01:03:58.223278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e127,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=943000000,duration_sec=1000,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:03:58.225089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:03:58.228157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:493 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Sep 25 01:03:58.753135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-939edaad-30e0-4eeb-9081-c3b50a933e21 service neutron] Resource Port c71c9659-825c-4f3d-b945-2c964a1f67a7 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=c71c9659-825c-4f3d-b945-2c964a1f67a7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=c71c9659-825c-4f3d-b945-2c964a1f67a7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:03:58.753876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-939edaad-30e0-4eeb-9081-c3b50a933e21 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (c71c9659-825c-4f3d-b945-2c964a1f67a7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:03:59.305725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-939edaad-30e0-4eeb-9081-c3b50a933e21 service neutron] Resource Port c71c9659-825c-4f3d-b945-2c964a1f67a7 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=c71c9659-825c-4f3d-b945-2c964a1f67a7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=c71c9659-825c-4f3d-b945-2c964a1f67a7,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=c71c9659-825c-4f3d-b945-2c964a1f67a7,segment=NetworkSegment(ed5ec111-24e0-4aad-b5c7-8fcadf6e28a3),segment_id=ed5ec111-24e0-4aad-b5c7-8fcadf6e28a3)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:03:59.307058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-939edaad-30e0-4eeb-9081-c3b50a933e21 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (c71c9659-825c-4f3d-b945-2c964a1f67a7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:04:00.212251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:494 started Sep 25 01:04:00.215019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e129,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=941000000,duration_sec=1002,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:04:00.215744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:04:00.216208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:494 - starting polling. Elapsed:0.004 Sep 25 01:04:00.219115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:04:00.223969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:494 - port information retrieved. Elapsed:0.012 Sep 25 01:04:00.224319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:494 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 25 01:04:02.213728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:495 started Sep 25 01:04:02.218693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e12b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=943000000,duration_sec=1004,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:04:02.219970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:04:02.223588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:495 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 25 01:04:02.340563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port c71c9659-825c-4f3d-b945-2c964a1f67a7 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:04:02.341220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (c71c9659-825c-4f3d-b945-2c964a1f67a7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:04:04.214836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:496 started Sep 25 01:04:04.219044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e12d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=944000000,duration_sec=1006,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:04:04.221161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:04:04.221921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:496 - starting polling. Elapsed:0.008 Sep 25 01:04:04.226855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:04:04.231476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:496 - port information retrieved. Elapsed:0.017 Sep 25 01:04:04.232838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:496 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.018 Sep 25 01:04:04.418431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port c71c9659-825c-4f3d-b945-2c964a1f67a7 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:04:04.419005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (c71c9659-825c-4f3d-b945-2c964a1f67a7), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:04:06.216339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:497 started Sep 25 01:04:06.218791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e12f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=945000000,duration_sec=1008,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:04:06.219385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:04:06.219730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:497 - starting polling. Elapsed:0.004 Sep 25 01:04:06.223055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:04:06.227176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:497 - port information retrieved. Elapsed:0.011 Sep 25 01:04:06.227645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:497 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 25 01:04:08.217928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:498 started Sep 25 01:04:08.221946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e131,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=947000000,duration_sec=1010,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:04:08.223090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:04:08.223671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:498 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:04:08.449752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-caf9b312-ec03-4a28-b217-8d60f8b017c3 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:04:07Z,data_plane_status=None,description='',device_id='4814bc8c-42fd-4665-9123-2feba2f7887f',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=9d97f0d8-3c7b-4ac3-8d16-6a80eec13764,mac_address=fa:16:3e:ff:53:b0,name='',network_id=31fa7821-6345-4f48-b070-9ceab6d12adf,numa_affinity_policy=,project_id='46f19fd9ad1e4880961d1eee75883687',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(9d97f0d8-3c7b-4ac3-8d16-6a80eec13764),security_group_ids=set([0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c]),status='DOWN',updated_at=2022-09-25T01:04:07Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:04:08.450972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-caf9b312-ec03-4a28-b217-8d60f8b017c3 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (9d97f0d8-3c7b-4ac3-8d16-6a80eec13764), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:04:08.452135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-caf9b312-ec03-4a28-b217-8d60f8b017c3 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Security group member updated {'0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c'} Sep 25 01:04:09.943451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-63e074fe-d662-4b1b-8889-4a95d99e3b7d service neutron] Resource Port 9d97f0d8-3c7b-4ac3-8d16-6a80eec13764 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=9d97f0d8-3c7b-4ac3-8d16-6a80eec13764,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=9d97f0d8-3c7b-4ac3-8d16-6a80eec13764,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:04:09.945096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-63e074fe-d662-4b1b-8889-4a95d99e3b7d service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (9d97f0d8-3c7b-4ac3-8d16-6a80eec13764), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:04:10.218657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:499 started Sep 25 01:04:10.222657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e133,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=947000000,duration_sec=1012,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:04:10.223625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:04:10.224169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:499 - starting polling. Elapsed:0.006 Sep 25 01:04:10.227160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:04:10.231696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:499 - port information retrieved. Elapsed:0.013 Sep 25 01:04:10.232312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:499 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 25 01:04:10.415909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-63e074fe-d662-4b1b-8889-4a95d99e3b7d service neutron] Resource Port 9d97f0d8-3c7b-4ac3-8d16-6a80eec13764 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=9d97f0d8-3c7b-4ac3-8d16-6a80eec13764,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=9d97f0d8-3c7b-4ac3-8d16-6a80eec13764,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=9d97f0d8-3c7b-4ac3-8d16-6a80eec13764,segment=NetworkSegment(5580d2ab-1c02-4162-bded-4b179649cc54),segment_id=5580d2ab-1c02-4162-bded-4b179649cc54)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:04:10.416391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-63e074fe-d662-4b1b-8889-4a95d99e3b7d service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (9d97f0d8-3c7b-4ac3-8d16-6a80eec13764), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:04:12.220112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:500 started Sep 25 01:04:12.223318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e135,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=949000000,duration_sec=1014,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:04:12.223998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:04:12.224383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:500 - starting polling. Elapsed:0.005 Sep 25 01:04:12.227860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:04:12.231732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:500 - port information retrieved. Elapsed:0.012 Sep 25 01:04:12.232079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:500 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 25 01:04:14.221161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:501 started Sep 25 01:04:14.224852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e137,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=950000000,duration_sec=1016,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:04:14.225701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:04:14.226116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:501 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:04:16.222356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:502 started Sep 25 01:04:16.225633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e139,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=951000000,duration_sec=1018,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:04:16.226351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:04:16.226792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:502 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:04:18.223631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:503 started Sep 25 01:04:18.227113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e13b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=952000000,duration_sec=1020,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:04:18.227727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:04:18.228085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:503 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:04:20.224163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:504 started Sep 25 01:04:20.226890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e13d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=953000000,duration_sec=1022,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:04:20.227534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:04:20.227882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:504 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:04:22.224772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:505 started Sep 25 01:04:22.227350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e13f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=953000000,duration_sec=1024,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:04:22.227959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:04:22.228320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:505 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:04:23.122717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 9d97f0d8-3c7b-4ac3-8d16-6a80eec13764 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:04:23.123104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (9d97f0d8-3c7b-4ac3-8d16-6a80eec13764), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:04:24.225892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:506 started Sep 25 01:04:24.228857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e141,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=955000000,duration_sec=1026,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:04:24.229510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:04:24.229852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:506 - starting polling. Elapsed:0.004 Sep 25 01:04:24.232527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:04:24.237120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:506 - port information retrieved. Elapsed:0.011 Sep 25 01:04:24.237489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:506 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 25 01:04:25.124540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 9d97f0d8-3c7b-4ac3-8d16-6a80eec13764 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:04:25.124920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (9d97f0d8-3c7b-4ac3-8d16-6a80eec13764), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:04:26.226928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:507 started Sep 25 01:04:26.230819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e143,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=956000000,duration_sec=1028,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:04:26.231412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:04:26.231844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:507 - starting polling. Elapsed:0.005 Sep 25 01:04:26.235885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:04:26.239444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:507 - port information retrieved. Elapsed:0.013 Sep 25 01:04:26.239788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:507 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 25 01:04:28.227804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:508 started Sep 25 01:04:28.230977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e145,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=956000000,duration_sec=1030,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:04:28.231742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:04:28.232234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:508 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:04:28.585233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-bfc8b540-f2ad-44b8-a87a-2ee8ce373b49 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:04:28Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=01415370-4941-44cb-8f4f-692ee9962082,mac_address=fa:16:3e:3f:96:15,name='',network_id=62195cd6-54fa-4e24-9d47-ae0de6356ac2,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(01415370-4941-44cb-8f4f-692ee9962082),security_group_ids=set([]),status='N/A',updated_at=2022-09-25T01:04:28Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:04:28.585745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-bfc8b540-f2ad-44b8-a87a-2ee8ce373b49 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (01415370-4941-44cb-8f4f-692ee9962082), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:04:29.443679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-bfc8b540-f2ad-44b8-a87a-2ee8ce373b49 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Resource Port 01415370-4941-44cb-8f4f-692ee9962082 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '72346b03-4ff4-4273-874d-c6ee76baa85f'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:04:29.444715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-bfc8b540-f2ad-44b8-a87a-2ee8ce373b49 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (01415370-4941-44cb-8f4f-692ee9962082), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:04:30.229593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:509 started Sep 25 01:04:30.233918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e147,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=958000000,duration_sec=1032,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:04:30.235410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:04:30.236510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:509 - starting polling. Elapsed:0.007 Sep 25 01:04:30.241803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:04:30.251007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:509 - port information retrieved. Elapsed:0.021 Sep 25 01:04:30.251554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:509 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.022 Sep 25 01:04:32.230676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:510 started Sep 25 01:04:32.233216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e149,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=959000000,duration_sec=1034,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:04:32.234125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:04:32.234490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:510 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:04:34.232365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:511 started Sep 25 01:04:34.235841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e14b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=961000000,duration_sec=1036,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:04:34.236503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:04:34.236974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:511 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:04:36.233873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:512 started Sep 25 01:04:36.237146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e14d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=963000000,duration_sec=1038,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:04:36.237801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:04:36.238206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:512 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:04:38.234595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:513 started Sep 25 01:04:38.237701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e14f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=963000000,duration_sec=1040,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:04:38.238398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:04:38.238836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:513 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:04:40.236071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:514 started Sep 25 01:04:40.239472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e151,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=965000000,duration_sec=1042,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:04:40.240233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:04:40.240702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:514 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:04:40.689401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9b83f02a-4c60-4da4-b247-d2978feb947e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:04:40Z,description='Default security group',id=89a1fb14-24d9-4db2-8a98-d067a49ab39b,is_default=True,name='default',project_id='7228453de1b4457b95497a5f27fe7c7a',revision_number=1,rules=[SecurityGroupRule(684fbe3c-7ae2-4c6f-8409-f5a47e3717c9),SecurityGroupRule(75e6d3a6-80f7-4ec5-b5b7-e60079020a9e),SecurityGroupRule(99ffb8af-5ab1-4bf9-9cb0-047f63b9b1ef),SecurityGroupRule(9d18d330-b00f-4602-8158-065e6bafa1e6)],shared=False,stateful=True,updated_at=2022-09-25T01:04:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:04:40.689917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9b83f02a-4c60-4da4-b247-d2978feb947e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (89a1fb14-24d9-4db2-8a98-d067a49ab39b), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:04:40.690640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9b83f02a-4c60-4da4-b247-d2978feb947e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:04:40Z,description=,direction='egress',ethertype='IPv4',id=684fbe3c-7ae2-4c6f-8409-f5a47e3717c9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7228453de1b4457b95497a5f27fe7c7a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=89a1fb14-24d9-4db2-8a98-d067a49ab39b,updated_at=2022-09-25T01:04:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:04:40.691012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9b83f02a-4c60-4da4-b247-d2978feb947e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (684fbe3c-7ae2-4c6f-8409-f5a47e3717c9), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:04:40.691358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9b83f02a-4c60-4da4-b247-d2978feb947e admin admin] Security group rule updated ['89a1fb14-24d9-4db2-8a98-d067a49ab39b'] Sep 25 01:04:40.692110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9b83f02a-4c60-4da4-b247-d2978feb947e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:04:40Z,description=,direction='egress',ethertype='IPv6',id=75e6d3a6-80f7-4ec5-b5b7-e60079020a9e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7228453de1b4457b95497a5f27fe7c7a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=89a1fb14-24d9-4db2-8a98-d067a49ab39b,updated_at=2022-09-25T01:04:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:04:40.692478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9b83f02a-4c60-4da4-b247-d2978feb947e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (75e6d3a6-80f7-4ec5-b5b7-e60079020a9e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:04:40.692810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9b83f02a-4c60-4da4-b247-d2978feb947e admin admin] Security group rule updated ['89a1fb14-24d9-4db2-8a98-d067a49ab39b'] Sep 25 01:04:40.693690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9b83f02a-4c60-4da4-b247-d2978feb947e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:04:40Z,description=,direction='ingress',ethertype='IPv6',id=99ffb8af-5ab1-4bf9-9cb0-047f63b9b1ef,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7228453de1b4457b95497a5f27fe7c7a',protocol=,remote_address_group_id=,remote_group_id=89a1fb14-24d9-4db2-8a98-d067a49ab39b,remote_ip_prefix=,revision_number=0,security_group_id=89a1fb14-24d9-4db2-8a98-d067a49ab39b,updated_at=2022-09-25T01:04:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:04:40.694059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9b83f02a-4c60-4da4-b247-d2978feb947e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (99ffb8af-5ab1-4bf9-9cb0-047f63b9b1ef), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:04:40.694418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9b83f02a-4c60-4da4-b247-d2978feb947e admin admin] Security group rule updated ['89a1fb14-24d9-4db2-8a98-d067a49ab39b'] Sep 25 01:04:40.695107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9b83f02a-4c60-4da4-b247-d2978feb947e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:04:40Z,description=,direction='ingress',ethertype='IPv4',id=9d18d330-b00f-4602-8158-065e6bafa1e6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7228453de1b4457b95497a5f27fe7c7a',protocol=,remote_address_group_id=,remote_group_id=89a1fb14-24d9-4db2-8a98-d067a49ab39b,remote_ip_prefix=,revision_number=0,security_group_id=89a1fb14-24d9-4db2-8a98-d067a49ab39b,updated_at=2022-09-25T01:04:40Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:04:40.695461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9b83f02a-4c60-4da4-b247-d2978feb947e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (9d18d330-b00f-4602-8158-065e6bafa1e6), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:04:40.695789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-9b83f02a-4c60-4da4-b247-d2978feb947e admin admin] Security group rule updated ['89a1fb14-24d9-4db2-8a98-d067a49ab39b'] Sep 25 01:04:40.883789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ae01d9e6-6df7-4644-8c38-eb9364678282 admin admin] Resource SecurityGroup deleted: 89a1fb14-24d9-4db2-8a98-d067a49ab39b {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:04:40.884278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ae01d9e6-6df7-4644-8c38-eb9364678282 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (89a1fb14-24d9-4db2-8a98-d067a49ab39b), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:04:40.884826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae01d9e6-6df7-4644-8c38-eb9364678282 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('89a1fb14-24d9-4db2-8a98-d067a49ab39b',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:04:40.905438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ae01d9e6-6df7-4644-8c38-eb9364678282 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('89a1fb14-24d9-4db2-8a98-d067a49ab39b',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:04:40.905962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ae01d9e6-6df7-4644-8c38-eb9364678282 admin admin] Resource SecurityGroupRule deleted: 684fbe3c-7ae2-4c6f-8409-f5a47e3717c9 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:04:40.906458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ae01d9e6-6df7-4644-8c38-eb9364678282 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (684fbe3c-7ae2-4c6f-8409-f5a47e3717c9), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:04:40.907496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ae01d9e6-6df7-4644-8c38-eb9364678282 admin admin] Security group rule updated ['89a1fb14-24d9-4db2-8a98-d067a49ab39b'] Sep 25 01:04:40.908059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ae01d9e6-6df7-4644-8c38-eb9364678282 admin admin] Resource SecurityGroupRule deleted: 75e6d3a6-80f7-4ec5-b5b7-e60079020a9e {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:04:40.908446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ae01d9e6-6df7-4644-8c38-eb9364678282 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (75e6d3a6-80f7-4ec5-b5b7-e60079020a9e), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:04:40.908822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ae01d9e6-6df7-4644-8c38-eb9364678282 admin admin] Security group rule updated ['89a1fb14-24d9-4db2-8a98-d067a49ab39b'] Sep 25 01:04:40.909208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ae01d9e6-6df7-4644-8c38-eb9364678282 admin admin] Resource SecurityGroupRule deleted: 99ffb8af-5ab1-4bf9-9cb0-047f63b9b1ef {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:04:40.909608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ae01d9e6-6df7-4644-8c38-eb9364678282 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (99ffb8af-5ab1-4bf9-9cb0-047f63b9b1ef), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:04:40.909935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ae01d9e6-6df7-4644-8c38-eb9364678282 admin admin] Security group rule updated ['89a1fb14-24d9-4db2-8a98-d067a49ab39b'] Sep 25 01:04:40.910319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ae01d9e6-6df7-4644-8c38-eb9364678282 admin admin] Resource SecurityGroupRule deleted: 9d18d330-b00f-4602-8158-065e6bafa1e6 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:04:40.910668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ae01d9e6-6df7-4644-8c38-eb9364678282 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (9d18d330-b00f-4602-8158-065e6bafa1e6), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:04:40.910991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ae01d9e6-6df7-4644-8c38-eb9364678282 admin admin] Security group rule updated ['89a1fb14-24d9-4db2-8a98-d067a49ab39b'] Sep 25 01:04:42.237241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:515 started Sep 25 01:04:42.241487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e153,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=966000000,duration_sec=1044,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:04:42.242169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:04:42.242535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:515 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:04:44.238312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:516 started Sep 25 01:04:44.241157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e155,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=967000000,duration_sec=1046,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:04:44.241789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:04:44.242355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:516 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:04:46.239616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:517 started Sep 25 01:04:46.242354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e157,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=968000000,duration_sec=1048,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:04:46.242965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:04:46.243474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:517 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:04:48.240432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:518 started Sep 25 01:04:48.243105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e159,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=969000000,duration_sec=1050,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:04:48.243679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:04:48.244082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:518 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:04:50.241717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:519 started Sep 25 01:04:50.244376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e15b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=970000000,duration_sec=1052,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:04:50.245018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:04:50.245467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:519 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:04:52.243050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:520 started Sep 25 01:04:52.245971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e15d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=971000000,duration_sec=1054,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:04:52.246621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:04:52.247011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:520 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:04:54.244321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:521 started Sep 25 01:04:54.247239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e15f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=973000000,duration_sec=1056,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:04:54.247877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:04:54.248283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:521 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:04:56.245984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:522 started Sep 25 01:04:56.248763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e161,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=974000000,duration_sec=1058,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:04:56.250115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:04:56.250514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:522 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:04:58.247260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:523 started Sep 25 01:04:58.250955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e163,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=976000000,duration_sec=1060,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:04:58.251645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:04:58.252025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:523 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:05:00.248845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:524 started Sep 25 01:05:00.251860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e165,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=977000000,duration_sec=1062,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:05:00.252531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:05:00.252958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:524 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:05:02.250247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:525 started Sep 25 01:05:02.252954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e167,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=979000000,duration_sec=1064,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:05:02.253641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:05:02.254032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:525 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:05:04.251313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:526 started Sep 25 01:05:04.254123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e169,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=980000000,duration_sec=1066,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:05:04.254720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:05:04.255115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:526 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:05:06.252493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:527 started Sep 25 01:05:06.255422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e16b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=981000000,duration_sec=1068,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:05:06.256019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:05:06.256494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:527 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:05:08.253813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:528 started Sep 25 01:05:08.256244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e16d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=982000000,duration_sec=1070,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:05:08.256823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:05:08.257207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:528 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:05:10.254544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:529 started Sep 25 01:05:10.257218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e16f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=983000000,duration_sec=1072,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:05:10.257846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:05:10.258459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:529 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:05:12.255945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:530 started Sep 25 01:05:12.259079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e171,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=985000000,duration_sec=1074,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:05:12.259822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:05:12.260325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:530 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:05:14.256633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:531 started Sep 25 01:05:14.259118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e173,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=985000000,duration_sec=1076,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:05:14.259702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:05:14.260062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:531 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:05:16.257941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:532 started Sep 25 01:05:16.261442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e175,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=987000000,duration_sec=1078,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:05:16.262154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:05:16.262601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:532 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:05:18.258842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:533 started Sep 25 01:05:18.261617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e177,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=987000000,duration_sec=1080,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:05:18.262216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:05:18.262576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:533 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:05:20.259594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:534 started Sep 25 01:05:20.262357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e179,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=988000000,duration_sec=1082,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:05:20.262933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:05:20.263289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:534 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:05:21.299694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 7589db85-95c8-412c-a8f7-5db156ef7906 updated (revision_number 5->6). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'DOWN'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:05:21.300346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (7589db85-95c8-412c-a8f7-5db156ef7906), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:05:22.261239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:535 started Sep 25 01:05:22.265928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e17b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=990000000,duration_sec=1084,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:05:22.267644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:05:22.268293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:535 - starting polling. Elapsed:0.007 Sep 25 01:05:22.273272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:05:22.281863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:535 - port information retrieved. Elapsed:0.021 Sep 25 01:05:22.282327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:535 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.021 Sep 25 01:05:24.261922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:536 started Sep 25 01:05:24.265522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e17d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=990000000,duration_sec=1086,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:05:24.266285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:05:24.266682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:536 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:05:26.262552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:537 started Sep 25 01:05:26.265939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e17f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=991000000,duration_sec=1088,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:05:26.266619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:05:26.267010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:537 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:05:28.263426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:538 started Sep 25 01:05:28.266977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e181,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=992000000,duration_sec=1090,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:05:28.267786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:05:28.268099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:538 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:05:30.264663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:539 started Sep 25 01:05:30.267775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e183,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=993000000,duration_sec=1092,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:05:30.268393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:05:30.268845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:539 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:05:31.404097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 7589db85-95c8-412c-a8f7-5db156ef7906 updated (revision_number 6->7). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:05:31.404729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (7589db85-95c8-412c-a8f7-5db156ef7906), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:05:32.266651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:540 started Sep 25 01:05:32.270714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e185,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=995000000,duration_sec=1094,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:05:32.271620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:05:32.272183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:540 - starting polling. Elapsed:0.007 Sep 25 01:05:32.277659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:05:32.285917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:540 - port information retrieved. Elapsed:0.020 Sep 25 01:05:32.286482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:540 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.021 Sep 25 01:05:33.388351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 7589db85-95c8-412c-a8f7-5db156ef7906 updated (revision_number 7->8). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:05:33.389072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (7589db85-95c8-412c-a8f7-5db156ef7906), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:05:34.266525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:541 started Sep 25 01:05:34.274687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e187,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=995000000,duration_sec=1096,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:05:34.274687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:05:34.274687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:541 - starting polling. Elapsed:0.004 Sep 25 01:05:34.274687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:05:34.278740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:541 - port information retrieved. Elapsed:0.012 Sep 25 01:05:34.279217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:541 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 25 01:05:36.267941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:542 started Sep 25 01:05:36.270987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e189,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=996000000,duration_sec=1098,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:05:36.271606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:05:36.271990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:542 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:05:38.268680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:543 started Sep 25 01:05:38.271986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e18b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=997000000,duration_sec=1100,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:05:38.272701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:05:38.273121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:543 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:05:40.269826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:544 started Sep 25 01:05:40.272379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e18d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=998000000,duration_sec=1102,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:05:40.272965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:05:40.273360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:544 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:05:42.271252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:545 started Sep 25 01:05:42.274007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e18f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=0,duration_sec=1105,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:05:42.274676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:05:42.275073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:545 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:05:44.273055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:546 started Sep 25 01:05:44.276458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e191,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=2000000,duration_sec=1107,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:05:44.277179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:05:44.277695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:546 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:05:46.274358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:547 started Sep 25 01:05:46.277633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e193,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=3000000,duration_sec=1109,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:05:46.278342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:05:46.278747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:547 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:05:48.275209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:548 started Sep 25 01:05:48.278157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e195,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=4000000,duration_sec=1111,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:05:48.278975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:05:48.279347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:548 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:05:50.276125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:549 started Sep 25 01:05:50.278661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e197,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=4000000,duration_sec=1113,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:05:50.279236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:05:50.279596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:549 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:05:52.277405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:550 started Sep 25 01:05:52.282314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e199,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=8000000,duration_sec=1115,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:05:52.282905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:05:52.283292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:550 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:05:54.277948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:551 started Sep 25 01:05:54.281119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e19b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=6000000,duration_sec=1117,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:05:54.281983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:05:54.282439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:551 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:05:56.279453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:552 started Sep 25 01:05:56.282619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e19d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=8000000,duration_sec=1119,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:05:56.283224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:05:56.283577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:552 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:05:58.280958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:553 started Sep 25 01:05:58.283727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e19f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=9000000,duration_sec=1121,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:05:58.284352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:05:58.284711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:553 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:06:00.281675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:554 started Sep 25 01:06:00.284145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1a1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=10000000,duration_sec=1123,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:00.284721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:06:00.285081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:554 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:06:02.282402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:555 started Sep 25 01:06:02.285033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1a3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=11000000,duration_sec=1125,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:02.285735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:06:02.286132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:555 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:06:04.283604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:556 started Sep 25 01:06:04.286757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1a5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=12000000,duration_sec=1127,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:04.287576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:06:04.288000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:556 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:06:06.284533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:557 started Sep 25 01:06:06.287703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1a7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=13000000,duration_sec=1129,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:06.288289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:06:06.288669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:557 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:06:07.976067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-63da76cf-6df0-456c-b48f-abb2c4439856 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Resource Port deleted: 01415370-4941-44cb-8f4f-692ee9962082 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:07.977298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-63da76cf-6df0-456c-b48f-abb2c4439856 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (01415370-4941-44cb-8f4f-692ee9962082), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:08.285476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:558 started Sep 25 01:06:08.288374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1a9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=14000000,duration_sec=1131,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:08.289499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:06:08.289849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:558 - starting polling. Elapsed:0.005 Sep 25 01:06:08.292528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:08.294627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 01415370-4941-44cb-8f4f-692ee9962082 not present in bridge br-int Sep 25 01:06:08.295091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:06:08.295091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['01415370-4941-44cb-8f4f-692ee9962082'] Sep 25 01:06:08.296460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 01415370-4941-44cb-8f4f-692ee9962082 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:06:08.300110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:558 - port information retrieved. Elapsed:0.015 Sep 25 01:06:08.300456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:558 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Sep 25 01:06:10.286767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:559 started Sep 25 01:06:10.291433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1ab,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=15000000,duration_sec=1133,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:10.298821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:06:10.299603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:559 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 25 01:06:11.322749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-24a647b0-2c76-428c-93aa-0eceae0fa085 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Resource Port deleted: 9d97f0d8-3c7b-4ac3-8d16-6a80eec13764 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:11.323651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-24a647b0-2c76-428c-93aa-0eceae0fa085 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (9d97f0d8-3c7b-4ac3-8d16-6a80eec13764), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:11.323651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-24a647b0-2c76-428c-93aa-0eceae0fa085 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Security group member updated {'0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c'} Sep 25 01:06:12.288223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:560 started Sep 25 01:06:12.291113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1ad,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=17000000,duration_sec=1135,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:12.291792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:06:12.292132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:560 - starting polling. Elapsed:0.004 Sep 25 01:06:12.294852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:12.296784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 9d97f0d8-3c7b-4ac3-8d16-6a80eec13764 not present in bridge br-int Sep 25 01:06:12.297134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:06:12.297449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['9d97f0d8-3c7b-4ac3-8d16-6a80eec13764'] Sep 25 01:06:12.297784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 9d97f0d8-3c7b-4ac3-8d16-6a80eec13764 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:06:12.301525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:560 - port information retrieved. Elapsed:0.013 Sep 25 01:06:12.301866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:560 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 25 01:06:14.289588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:561 started Sep 25 01:06:14.292465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1af,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=18000000,duration_sec=1137,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:14.293148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:06:14.293753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:561 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:06:15.400625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e3bf8497-c6a1-43a2-968b-dceee9856287 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Resource Port deleted: 6d29a34f-6d17-4ad7-bb52-9a884e6f97c8 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:15.402063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e3bf8497-c6a1-43a2-968b-dceee9856287 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (6d29a34f-6d17-4ad7-bb52-9a884e6f97c8), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:16.291817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:562 started Sep 25 01:06:16.296274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1b1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=20000000,duration_sec=1139,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:16.297614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:06:16.298913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:562 - starting polling. Elapsed:0.007 Sep 25 01:06:16.304436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:16.308352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 6d29a34f-6d17-4ad7-bb52-9a884e6f97c8 not present in bridge br-int Sep 25 01:06:16.309225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:06:16.310010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['6d29a34f-6d17-4ad7-bb52-9a884e6f97c8'] Sep 25 01:06:16.311439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 6d29a34f-6d17-4ad7-bb52-9a884e6f97c8 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:06:16.318585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:562 - port information retrieved. Elapsed:0.027 Sep 25 01:06:16.319445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:562 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.028 Sep 25 01:06:18.293369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:563 started Sep 25 01:06:18.297799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1b3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=22000000,duration_sec=1141,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:18.298726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:06:18.299495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:563 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:06:18.991752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f5590b5e-9441-427c-bcd2-0f79733572e3 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Resource Port deleted: b7527175-254d-4003-8922-2e8834ba4a91 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:18.992375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f5590b5e-9441-427c-bcd2-0f79733572e3 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (b7527175-254d-4003-8922-2e8834ba4a91), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:18.993220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f5590b5e-9441-427c-bcd2-0f79733572e3 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Security group member updated {'0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c'} Sep 25 01:06:20.294067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:564 started Sep 25 01:06:20.298354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1b5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=23000000,duration_sec=1143,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:20.299012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:06:20.299500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:564 - starting polling. Elapsed:0.005 Sep 25 01:06:20.302541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:20.304395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port b7527175-254d-4003-8922-2e8834ba4a91 not present in bridge br-int Sep 25 01:06:20.304770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:06:20.305165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['b7527175-254d-4003-8922-2e8834ba4a91'] Sep 25 01:06:20.305567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port b7527175-254d-4003-8922-2e8834ba4a91 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:06:20.309679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:564 - port information retrieved. Elapsed:0.016 Sep 25 01:06:20.310164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:564 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Sep 25 01:06:21.706308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4b00259d-e19c-4902-8ebd-e3a900dfd733 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Resource Port deleted: e2bc3cd9-0fce-4cc1-8449-ae53d35f069f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:21.707477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4b00259d-e19c-4902-8ebd-e3a900dfd733 tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (e2bc3cd9-0fce-4cc1-8449-ae53d35f069f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:22.294853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:565 started Sep 25 01:06:22.298033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1b7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=24000000,duration_sec=1145,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:22.298897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:06:22.299286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:565 - starting polling. Elapsed:0.005 Sep 25 01:06:22.302567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:22.305186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port e2bc3cd9-0fce-4cc1-8449-ae53d35f069f not present in bridge br-int Sep 25 01:06:22.305621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:06:22.306035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['e2bc3cd9-0fce-4cc1-8449-ae53d35f069f'] Sep 25 01:06:22.306480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port e2bc3cd9-0fce-4cc1-8449-ae53d35f069f is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:06:22.311842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:565 - port information retrieved. Elapsed:0.017 Sep 25 01:06:22.312252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:565 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.018 Sep 25 01:06:23.245097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4537079b-170f-4cc3-8ed6-4758de9a160a tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Resource SecurityGroup deleted: 0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:23.245741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4537079b-170f-4cc3-8ed6-4758de9a160a tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:23.246049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4537079b-170f-4cc3-8ed6-4758de9a160a tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:06:23.262101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4537079b-170f-4cc3-8ed6-4758de9a160a tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:06:23.262765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4537079b-170f-4cc3-8ed6-4758de9a160a tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Resource SecurityGroupRule deleted: 26526b29-166a-4837-b75d-1e91b867a485 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:23.263208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4537079b-170f-4cc3-8ed6-4758de9a160a tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (26526b29-166a-4837-b75d-1e91b867a485), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:23.263660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-4537079b-170f-4cc3-8ed6-4758de9a160a tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Security group rule updated ['0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c'] Sep 25 01:06:23.264828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4537079b-170f-4cc3-8ed6-4758de9a160a tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Resource SecurityGroupRule deleted: e5eb6f91-37b3-4ff7-81e3-593481f25547 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:23.265589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4537079b-170f-4cc3-8ed6-4758de9a160a tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (e5eb6f91-37b3-4ff7-81e3-593481f25547), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:23.265788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-4537079b-170f-4cc3-8ed6-4758de9a160a tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Security group rule updated ['0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c'] Sep 25 01:06:23.266172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4537079b-170f-4cc3-8ed6-4758de9a160a tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Resource SecurityGroupRule deleted: cad4d84d-14a0-4bbe-8e4f-db4708e1cc51 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:23.266566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4537079b-170f-4cc3-8ed6-4758de9a160a tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (cad4d84d-14a0-4bbe-8e4f-db4708e1cc51), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:23.266892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-4537079b-170f-4cc3-8ed6-4758de9a160a tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Security group rule updated ['0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c'] Sep 25 01:06:23.267286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4537079b-170f-4cc3-8ed6-4758de9a160a tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Resource SecurityGroupRule deleted: 2e91c38f-123d-4c9b-a32e-0bdb9fecc811 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:23.267707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4537079b-170f-4cc3-8ed6-4758de9a160a tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (2e91c38f-123d-4c9b-a32e-0bdb9fecc811), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:23.268033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-4537079b-170f-4cc3-8ed6-4758de9a160a tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Security group rule updated ['0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c'] Sep 25 01:06:23.273327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4537079b-170f-4cc3-8ed6-4758de9a160a tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Resource SecurityGroupRule deleted: 1a93d59a-3537-409f-9d48-42cfcfb66494 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:23.273327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4537079b-170f-4cc3-8ed6-4758de9a160a tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (1a93d59a-3537-409f-9d48-42cfcfb66494), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:23.273327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-4537079b-170f-4cc3-8ed6-4758de9a160a tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Security group rule updated ['0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c'] Sep 25 01:06:23.273327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4537079b-170f-4cc3-8ed6-4758de9a160a tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Resource SecurityGroupRule deleted: 98046b00-cf39-41a3-977b-863c5a3f5997 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:23.273947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4537079b-170f-4cc3-8ed6-4758de9a160a tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (98046b00-cf39-41a3-977b-863c5a3f5997), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:23.273947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-4537079b-170f-4cc3-8ed6-4758de9a160a tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Security group rule updated ['0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c'] Sep 25 01:06:23.273947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4537079b-170f-4cc3-8ed6-4758de9a160a tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Resource SecurityGroupRule deleted: 847e03d8-ae41-4687-83aa-fea86ceaa734 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:23.273947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4537079b-170f-4cc3-8ed6-4758de9a160a tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (847e03d8-ae41-4687-83aa-fea86ceaa734), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:23.274344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-4537079b-170f-4cc3-8ed6-4758de9a160a tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Security group rule updated ['0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c'] Sep 25 01:06:23.274344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4537079b-170f-4cc3-8ed6-4758de9a160a tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Resource SecurityGroupRule deleted: 7baef2f8-60d5-4771-9787-8d3bda636d64 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:23.274344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-4537079b-170f-4cc3-8ed6-4758de9a160a tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (7baef2f8-60d5-4771-9787-8d3bda636d64), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:23.274344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-4537079b-170f-4cc3-8ed6-4758de9a160a tempest-TestVolumeBootPattern-1642664612 tempest-TestVolumeBootPattern-1642664612-project] Security group rule updated ['0fc42f2e-87f2-46d5-99c6-41c4c53f6a0c'] Sep 25 01:06:24.296213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:566 started Sep 25 01:06:24.299452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1b9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=25000000,duration_sec=1147,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:24.300327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:06:24.300944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:566 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:06:24.407809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ebdfb4f2-6d06-4dcd-b1b8-64366968b6dc admin admin] Resource Port deleted: 4a688d1f-1335-463f-b319-bcba153c442f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:24.408595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ebdfb4f2-6d06-4dcd-b1b8-64366968b6dc admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (4a688d1f-1335-463f-b319-bcba153c442f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:25.696959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["e5a81c94-dd46-4b89-ba18-21fbdc5310b0","delete","qr-4a688d1f-13",19,["map",[["attached-mac","fa:16:3e:dc:95:fe"],["iface-id","4a688d1f-1335-463f-b319-bcba153c442f"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:06:25.704509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-335c0d67-ccc8-455d-814c-cafabe7bd47c admin admin] Resource Port deleted: d2abc674-9be0-4d84-bba8-aeef142e4a64 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:25.705223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-335c0d67-ccc8-455d-814c-cafabe7bd47c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (d2abc674-9be0-4d84-bba8-aeef142e4a64), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:26.146590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a1ae14f9-ee9b-4b9e-8147-0c626361442b","delete","qg-d2abc674-9b",20,["map",[["attached-mac","fa:16:3e:d7:42:a2"],["iface-id","d2abc674-9be0-4d84-bba8-aeef142e4a64"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:06:26.296860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:567 started Sep 25 01:06:26.458491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1bb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=182000000,duration_sec=1149,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:26.462179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:06:26.463114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:567 - starting polling. Elapsed:0.166 Sep 25 01:06:26.468309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:26.476925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e1bd,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 19}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:26.480814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e1bf,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 20}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:26.481349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:567 - port information retrieved. Elapsed:0.185 Sep 25 01:06:26.482198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'41a4501b-2acb-4e3d-a37d-bedbcdc6c76d', '0feb7341-0637-4360-9832-808376ee9e2a', '2f0cdd80-0129-4756-a061-a2bfb559e884', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', 'd18a3c48-8be7-45c0-8641-dd3182b273bc', 'dc092d9f-c63d-420c-8856-ecb381597fd7', '312a0875-9d08-4c94-b6f3-3135500afa6a', 'de4727a2-569d-44c6-a53e-ecc89817f610', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '71ee88f3-d4ca-4676-ab1f-7494784204fa', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', '025c4caf-135a-4da4-9e95-24f950bedb8b', '9f8092b0-2114-41f4-953a-0c53e92ff7ba', 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92'}, 'added': set(), 'removed': {'4a688d1f-1335-463f-b319-bcba153c442f', 'd2abc674-9be0-4d84-bba8-aeef142e4a64'}, 'updated': set(), 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:06:26.483483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:567 - agent port security group processed in 0.000 Sep 25 01:06:26.490749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up [] and devices down [] completed. Sep 25 01:06:26.491410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for {'4a688d1f-1335-463f-b319-bcba153c442f', 'd2abc674-9be0-4d84-bba8-aeef142e4a64'} Sep 25 01:06:26.492115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 8 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:06:26.531935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d4ad0991-6aaf-4365-bf78-8233a6a2d6cb admin admin] Resource Subnet deleted: d10d11e6-b8a0-482d-9762-c8b3bdb048d3 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:26.532854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d4ad0991-6aaf-4365-bf78-8233a6a2d6cb admin admin] Publish callbacks [] for Subnet (d10d11e6-b8a0-482d-9762-c8b3bdb048d3), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:26.566381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccb09fc-6dc9-47b1-9ac0-fb6872150e72]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:06:26.567127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Ports {'4a688d1f-1335-463f-b319-bcba153c442f', 'd2abc674-9be0-4d84-bba8-aeef142e4a64'} removed Sep 25 01:06:26.672481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port removal failed for set() {{(pid=107261) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 25 01:06:26.673783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:567 - treat_devices_removed completed in 0.182 Sep 25 01:06:26.674743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:567 - ports processed. Elapsed:0.378 Sep 25 01:06:26.675546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:567 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.379 Sep 25 01:06:26.739954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["bcee08d7-d53b-4e22-a835-09abbe590202","delete","tap9f8092b0-21",18,["map",[["attached-mac","fa:16:3e:23:17:d5"],["iface-id","9f8092b0-2114-41f4-953a-0c53e92ff7ba"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:06:26.970118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b9a9b7e1-de5c-499e-9bdd-e09e48331a65 admin admin] Resource Port deleted: 9f8092b0-2114-41f4-953a-0c53e92ff7ba {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:26.970994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b9a9b7e1-de5c-499e-9bdd-e09e48331a65 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (9f8092b0-2114-41f4-953a-0c53e92ff7ba), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:27.111451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4edbe65b-b237-4723-ab29-188f3fd5f145 None None] Resource Port deleted: 9f8092b0-2114-41f4-953a-0c53e92ff7ba {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:27.111783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-4edbe65b-b237-4723-ab29-188f3fd5f145 None None] Skipped duplicate delete event for 9f8092b0-2114-41f4-953a-0c53e92ff7ba {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 25 01:06:27.290663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b9a9b7e1-de5c-499e-9bdd-e09e48331a65 admin admin] Resource Network deleted: 31fa7821-6345-4f48-b070-9ceab6d12adf {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:27.291064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b9a9b7e1-de5c-499e-9bdd-e09e48331a65 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (31fa7821-6345-4f48-b070-9ceab6d12adf), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:28.299343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:568 started Sep 25 01:06:28.302569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1c1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=28000000,duration_sec=1151,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:28.303333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:06:28.304102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:568 - starting polling. Elapsed:0.005 Sep 25 01:06:28.306747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:28.313966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e1c3,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 18}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:28.314381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:568 - port information retrieved. Elapsed:0.015 Sep 25 01:06:28.314994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'41a4501b-2acb-4e3d-a37d-bedbcdc6c76d', '0feb7341-0637-4360-9832-808376ee9e2a', '2f0cdd80-0129-4756-a061-a2bfb559e884', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', 'd18a3c48-8be7-45c0-8641-dd3182b273bc', 'dc092d9f-c63d-420c-8856-ecb381597fd7', '312a0875-9d08-4c94-b6f3-3135500afa6a', 'de4727a2-569d-44c6-a53e-ecc89817f610', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '71ee88f3-d4ca-4676-ab1f-7494784204fa', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '783df414-cffa-4596-a921-2b930804680d', '025c4caf-135a-4da4-9e95-24f950bedb8b', 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92'}, 'added': set(), 'removed': {'9f8092b0-2114-41f4-953a-0c53e92ff7ba'}, 'updated': set(), 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:06:28.317715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:568 - agent port security group processed in 0.000 Sep 25 01:06:28.320059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up [] and devices down [] completed. Sep 25 01:06:28.320371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for {'9f8092b0-2114-41f4-953a-0c53e92ff7ba'} Sep 25 01:06:28.320841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 4 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:06:28.352831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b246a6c6-591c-441d-a180-3dc90de23f84 admin admin] Resource Port deleted: 312a0875-9d08-4c94-b6f3-3135500afa6a {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:28.353501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b246a6c6-591c-441d-a180-3dc90de23f84 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (312a0875-9d08-4c94-b6f3-3135500afa6a), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:28.384132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4446fa-dd5f-4a96-b072-03b68fc84a54]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:06:28.385044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Ports {'9f8092b0-2114-41f4-953a-0c53e92ff7ba'} removed Sep 25 01:06:28.430857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port removal failed for set() {{(pid=107261) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 25 01:06:28.431775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Reclaiming vlan = 8 from net-id = 31fa7821-6345-4f48-b070-9ceab6d12adf, seg-id = 59 Sep 25 01:06:28.436868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xa5d7ab5e,OFPFlowMod(buffer_id=4294967295,command=3,cookie=13979250796582379444,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4104}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:28.442309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x7834e1c5,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4155}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:28.442636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:568 - treat_devices_removed completed in 0.122 Sep 25 01:06:28.442947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:568 - ports processed. Elapsed:0.144 Sep 25 01:06:28.443285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:568 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.144 Sep 25 01:06:29.576627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8ce2b496-ef21-42ec-b4b9-a1b9f5660ad4","delete","qr-312a0875-9d",22,["map",[["attached-mac","fa:16:3e:e8:a4:64"],["iface-id","312a0875-9d08-4c94-b6f3-3135500afa6a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:06:29.672381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c55d23d0-f724-4c65-b6e0-146e226ae982 admin admin] Resource Port deleted: 783df414-cffa-4596-a921-2b930804680d {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:29.673089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c55d23d0-f724-4c65-b6e0-146e226ae982 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (783df414-cffa-4596-a921-2b930804680d), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:30.037358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["fabe913c-51db-47a2-8aee-f8fb89e28f41","delete","qg-783df414-cf",23,["map",[["attached-mac","fa:16:3e:ab:c1:14"],["iface-id","783df414-cffa-4596-a921-2b930804680d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:06:30.235163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5732399f-d56c-4634-a683-e076b98fdf74 admin admin] Resource Subnet deleted: 23b6c853-6aa6-4b19-9c76-ddde24e53ac3 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:30.236717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5732399f-d56c-4634-a683-e076b98fdf74 admin admin] Publish callbacks [] for Subnet (23b6c853-6aa6-4b19-9c76-ddde24e53ac3), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:30.300261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:569 started Sep 25 01:06:30.335324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1c7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=54000000,duration_sec=1153,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:30.336269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:06:30.337129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:569 - starting polling. Elapsed:0.037 Sep 25 01:06:30.342080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:30.350723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e1c9,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 22}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:30.355392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e1cb,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 23}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:30.356156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:569 - port information retrieved. Elapsed:0.056 Sep 25 01:06:30.359789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'41a4501b-2acb-4e3d-a37d-bedbcdc6c76d', '0feb7341-0637-4360-9832-808376ee9e2a', '2f0cdd80-0129-4756-a061-a2bfb559e884', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', 'd18a3c48-8be7-45c0-8641-dd3182b273bc', 'dc092d9f-c63d-420c-8856-ecb381597fd7', 'de4727a2-569d-44c6-a53e-ecc89817f610', '06b2816e-8529-43d4-82ae-6b0cacaeb5be', '5204c0c3-4410-4695-a405-b599292c4e80', '71ee88f3-d4ca-4676-ab1f-7494784204fa', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '025c4caf-135a-4da4-9e95-24f950bedb8b', 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92'}, 'added': set(), 'removed': {'783df414-cffa-4596-a921-2b930804680d', '312a0875-9d08-4c94-b6f3-3135500afa6a'}, 'updated': set(), 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:06:30.359789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:569 - agent port security group processed in 0.000 Sep 25 01:06:30.359789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up [] and devices down [] completed. Sep 25 01:06:30.360331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for {'783df414-cffa-4596-a921-2b930804680d', '312a0875-9d08-4c94-b6f3-3135500afa6a'} Sep 25 01:06:30.361151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 8 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:06:30.433573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[76faad4c-bbc2-41f1-8492-3c8293b8bd9f]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:06:30.436055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Ports {'783df414-cffa-4596-a921-2b930804680d', '312a0875-9d08-4c94-b6f3-3135500afa6a'} removed Sep 25 01:06:30.444117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["6571cd8d-27f4-4a71-8ddd-8462d51dd92d","delete","tap06b2816e-85",21,["map",[["attached-mac","fa:16:3e:d8:28:e0"],["iface-id","06b2816e-8529-43d4-82ae-6b0cacaeb5be"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:06:30.522443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port removal failed for set() {{(pid=107261) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 25 01:06:30.523267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:569 - treat_devices_removed completed in 0.163 Sep 25 01:06:30.523778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:569 - ports processed. Elapsed:0.224 Sep 25 01:06:30.525159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:569 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.224 Sep 25 01:06:30.756872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0cffcc5a-c768-4e10-b017-97ce9ba0e074 admin admin] Resource Port deleted: 06b2816e-8529-43d4-82ae-6b0cacaeb5be {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:30.757907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0cffcc5a-c768-4e10-b017-97ce9ba0e074 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (06b2816e-8529-43d4-82ae-6b0cacaeb5be), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:30.869227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-dbd24386-9a66-4d46-bcf5-8a43aded06a3 None None] Resource Port deleted: 06b2816e-8529-43d4-82ae-6b0cacaeb5be {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:30.870223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-dbd24386-9a66-4d46-bcf5-8a43aded06a3 None None] Skipped duplicate delete event for 06b2816e-8529-43d4-82ae-6b0cacaeb5be {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 25 01:06:31.051315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0cffcc5a-c768-4e10-b017-97ce9ba0e074 admin admin] Resource Network deleted: ca4cd8bc-b7e9-4c6f-bdc8-805e0843ee8e {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:31.052224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0cffcc5a-c768-4e10-b017-97ce9ba0e074 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (ca4cd8bc-b7e9-4c6f-bdc8-805e0843ee8e), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:31.375504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e86815ae-891d-4347-885f-dff01ad5f746 admin admin] Resource SecurityGroup deleted: bdf7eab8-1557-4218-bbcf-0cb26eb9cfc7 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:31.376383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e86815ae-891d-4347-885f-dff01ad5f746 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (bdf7eab8-1557-4218-bbcf-0cb26eb9cfc7), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:31.377330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86815ae-891d-4347-885f-dff01ad5f746 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('bdf7eab8-1557-4218-bbcf-0cb26eb9cfc7',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:06:31.392850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e86815ae-891d-4347-885f-dff01ad5f746 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('bdf7eab8-1557-4218-bbcf-0cb26eb9cfc7',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:06:31.393359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e86815ae-891d-4347-885f-dff01ad5f746 admin admin] Resource SecurityGroupRule deleted: 596134b6-6e7c-43ba-859b-031c2a8ede38 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:31.393730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e86815ae-891d-4347-885f-dff01ad5f746 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (596134b6-6e7c-43ba-859b-031c2a8ede38), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:31.394070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-e86815ae-891d-4347-885f-dff01ad5f746 admin admin] Security group rule updated ['bdf7eab8-1557-4218-bbcf-0cb26eb9cfc7'] Sep 25 01:06:31.394470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e86815ae-891d-4347-885f-dff01ad5f746 admin admin] Resource SecurityGroupRule deleted: 795e84ab-e923-4271-9ab7-5abca6126d40 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:31.394815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e86815ae-891d-4347-885f-dff01ad5f746 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (795e84ab-e923-4271-9ab7-5abca6126d40), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:31.395139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-e86815ae-891d-4347-885f-dff01ad5f746 admin admin] Security group rule updated ['bdf7eab8-1557-4218-bbcf-0cb26eb9cfc7'] Sep 25 01:06:31.395514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e86815ae-891d-4347-885f-dff01ad5f746 admin admin] Resource SecurityGroupRule deleted: c6813459-470c-45df-9ac1-1ed3c69e2f19 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:31.395856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e86815ae-891d-4347-885f-dff01ad5f746 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (c6813459-470c-45df-9ac1-1ed3c69e2f19), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:31.396176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-e86815ae-891d-4347-885f-dff01ad5f746 admin admin] Security group rule updated ['bdf7eab8-1557-4218-bbcf-0cb26eb9cfc7'] Sep 25 01:06:31.396536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e86815ae-891d-4347-885f-dff01ad5f746 admin admin] Resource SecurityGroupRule deleted: cf3c8655-8325-437d-b48a-5931873a4c09 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:31.397053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e86815ae-891d-4347-885f-dff01ad5f746 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (cf3c8655-8325-437d-b48a-5931873a4c09), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:31.397398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-e86815ae-891d-4347-885f-dff01ad5f746 admin admin] Security group rule updated ['bdf7eab8-1557-4218-bbcf-0cb26eb9cfc7'] Sep 25 01:06:32.054681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-580ba590-8678-45a7-ae18-a34a05f191f0 admin admin] Resource SecurityGroup deleted: 492dbb31-9757-44c7-b90f-65bdee6f6e5f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:32.055663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-580ba590-8678-45a7-ae18-a34a05f191f0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (492dbb31-9757-44c7-b90f-65bdee6f6e5f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:32.055876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580ba590-8678-45a7-ae18-a34a05f191f0 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('492dbb31-9757-44c7-b90f-65bdee6f6e5f',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:06:32.071881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-580ba590-8678-45a7-ae18-a34a05f191f0 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('492dbb31-9757-44c7-b90f-65bdee6f6e5f',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:06:32.072347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-580ba590-8678-45a7-ae18-a34a05f191f0 admin admin] Resource SecurityGroupRule deleted: 4176b4c7-fbaa-4cda-8ddb-f69b91140a91 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:32.072724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-580ba590-8678-45a7-ae18-a34a05f191f0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (4176b4c7-fbaa-4cda-8ddb-f69b91140a91), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:32.073068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-580ba590-8678-45a7-ae18-a34a05f191f0 admin admin] Security group rule updated ['492dbb31-9757-44c7-b90f-65bdee6f6e5f'] Sep 25 01:06:32.073595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-580ba590-8678-45a7-ae18-a34a05f191f0 admin admin] Resource SecurityGroupRule deleted: 6d864efc-bc00-42b9-9b9b-8afe48a9a86c {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:32.073947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-580ba590-8678-45a7-ae18-a34a05f191f0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (6d864efc-bc00-42b9-9b9b-8afe48a9a86c), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:32.074267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-580ba590-8678-45a7-ae18-a34a05f191f0 admin admin] Security group rule updated ['492dbb31-9757-44c7-b90f-65bdee6f6e5f'] Sep 25 01:06:32.074641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-580ba590-8678-45a7-ae18-a34a05f191f0 admin admin] Resource SecurityGroupRule deleted: f34926eb-b92a-4ea6-84b3-9c371bffe620 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:32.074977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-580ba590-8678-45a7-ae18-a34a05f191f0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f34926eb-b92a-4ea6-84b3-9c371bffe620), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:32.075299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-580ba590-8678-45a7-ae18-a34a05f191f0 admin admin] Security group rule updated ['492dbb31-9757-44c7-b90f-65bdee6f6e5f'] Sep 25 01:06:32.075667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-580ba590-8678-45a7-ae18-a34a05f191f0 admin admin] Resource SecurityGroupRule deleted: fab3cf16-7300-4b16-8387-54d6b0ce4d4f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:32.076002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-580ba590-8678-45a7-ae18-a34a05f191f0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (fab3cf16-7300-4b16-8387-54d6b0ce4d4f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:32.077640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-580ba590-8678-45a7-ae18-a34a05f191f0 admin admin] Security group rule updated ['492dbb31-9757-44c7-b90f-65bdee6f6e5f'] Sep 25 01:06:32.302950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:570 started Sep 25 01:06:32.305444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1cd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=31000000,duration_sec=1155,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:32.306072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:06:32.306513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:570 - starting polling. Elapsed:0.004 Sep 25 01:06:32.308709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:32.314271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e1cf,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 21}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:32.314577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:570 - port information retrieved. Elapsed:0.012 Sep 25 01:06:32.314796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'41a4501b-2acb-4e3d-a37d-bedbcdc6c76d', '0feb7341-0637-4360-9832-808376ee9e2a', '2f0cdd80-0129-4756-a061-a2bfb559e884', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', 'd18a3c48-8be7-45c0-8641-dd3182b273bc', 'dc092d9f-c63d-420c-8856-ecb381597fd7', 'de4727a2-569d-44c6-a53e-ecc89817f610', '5204c0c3-4410-4695-a405-b599292c4e80', '71ee88f3-d4ca-4676-ab1f-7494784204fa', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '025c4caf-135a-4da4-9e95-24f950bedb8b', 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92'}, 'added': set(), 'removed': {'06b2816e-8529-43d4-82ae-6b0cacaeb5be'}, 'updated': set(), 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:06:32.315126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:570 - agent port security group processed in 0.000 Sep 25 01:06:32.317072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up [] and devices down [] completed. Sep 25 01:06:32.317405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for {'06b2816e-8529-43d4-82ae-6b0cacaeb5be'} Sep 25 01:06:32.317961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 4 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:06:32.356809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eea5df0-ed3c-42de-b5e1-546ce413db4d]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:06:32.359430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Ports {'06b2816e-8529-43d4-82ae-6b0cacaeb5be'} removed Sep 25 01:06:32.401921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port removal failed for set() {{(pid=107261) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 25 01:06:32.402412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Reclaiming vlan = 9 from net-id = ca4cd8bc-b7e9-4c6f-bdc8-805e0843ee8e, seg-id = 86 Sep 25 01:06:32.407757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xa5d7ab60,OFPFlowMod(buffer_id=4294967295,command=3,cookie=13979250796582379444,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4105}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:32.412130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x7834e1d1,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4182}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:32.413058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:570 - treat_devices_removed completed in 0.096 Sep 25 01:06:32.413537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:570 - ports processed. Elapsed:0.111 Sep 25 01:06:32.414061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:570 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.111 Sep 25 01:06:34.304158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:571 started Sep 25 01:06:34.308875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1d3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=32000000,duration_sec=1157,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:34.310678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:06:34.311054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:571 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 01:06:36.305456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:572 started Sep 25 01:06:36.307825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1d5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=34000000,duration_sec=1159,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:36.308401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:06:36.308750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:572 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 25 01:06:38.306750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:573 started Sep 25 01:06:38.309849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1d7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=36000000,duration_sec=1161,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:38.310560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:06:38.311086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:573 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:06:40.307516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:574 started Sep 25 01:06:40.310940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1d9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=36000000,duration_sec=1163,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:40.311684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:06:40.311903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:574 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:06:42.309021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:575 started Sep 25 01:06:42.313491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1db,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=38000000,duration_sec=1165,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:42.314393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:06:42.314871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:575 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:06:44.309494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:576 started Sep 25 01:06:44.312568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1dd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=38000000,duration_sec=1167,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:44.313623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:06:44.313981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:576 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:06:45.529903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6d662d55-cb51-48e7-86b3-04e27e4f3169 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Resource Port deleted: c71c9659-825c-4f3d-b945-2c964a1f67a7 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:45.532940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6d662d55-cb51-48e7-86b3-04e27e4f3169 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (c71c9659-825c-4f3d-b945-2c964a1f67a7), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:45.536270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-6d662d55-cb51-48e7-86b3-04e27e4f3169 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Security group member updated {'bfb86a56-b21b-42ad-94ac-a717aef8569c'} Sep 25 01:06:46.315589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:577 started Sep 25 01:06:46.319172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1df,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=45000000,duration_sec=1169,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:46.319757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:06:46.320448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:577 - starting polling. Elapsed:0.005 Sep 25 01:06:46.323313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:46.326359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port c71c9659-825c-4f3d-b945-2c964a1f67a7 not present in bridge br-int Sep 25 01:06:46.327132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:06:46.327836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['c71c9659-825c-4f3d-b945-2c964a1f67a7'] Sep 25 01:06:46.328181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port c71c9659-825c-4f3d-b945-2c964a1f67a7 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:06:46.331846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:577 - port information retrieved. Elapsed:0.016 Sep 25 01:06:46.332162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:577 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Sep 25 01:06:47.706556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-bccca0ba-cecc-45a4-b0f3-a21897fb4ff7 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Resource SecurityGroup deleted: bfb86a56-b21b-42ad-94ac-a717aef8569c {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:47.707688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-bccca0ba-cecc-45a4-b0f3-a21897fb4ff7 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (bfb86a56-b21b-42ad-94ac-a717aef8569c), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:47.708362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bccca0ba-cecc-45a4-b0f3-a21897fb4ff7 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('bfb86a56-b21b-42ad-94ac-a717aef8569c',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:06:47.737761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-bccca0ba-cecc-45a4-b0f3-a21897fb4ff7 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('bfb86a56-b21b-42ad-94ac-a717aef8569c',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:06:47.738089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-bccca0ba-cecc-45a4-b0f3-a21897fb4ff7 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Resource SecurityGroupRule deleted: 063ae63e-8492-4e62-9b01-cd6855d71472 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:47.738364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-bccca0ba-cecc-45a4-b0f3-a21897fb4ff7 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (063ae63e-8492-4e62-9b01-cd6855d71472), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:47.738939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-bccca0ba-cecc-45a4-b0f3-a21897fb4ff7 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Security group rule updated ['bfb86a56-b21b-42ad-94ac-a717aef8569c'] Sep 25 01:06:47.739393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-bccca0ba-cecc-45a4-b0f3-a21897fb4ff7 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Resource SecurityGroupRule deleted: 07b9348b-ca61-4d23-aaf5-1488609a36d2 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:47.739776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-bccca0ba-cecc-45a4-b0f3-a21897fb4ff7 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (07b9348b-ca61-4d23-aaf5-1488609a36d2), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:47.740249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-bccca0ba-cecc-45a4-b0f3-a21897fb4ff7 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Security group rule updated ['bfb86a56-b21b-42ad-94ac-a717aef8569c'] Sep 25 01:06:47.740832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-bccca0ba-cecc-45a4-b0f3-a21897fb4ff7 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Resource SecurityGroupRule deleted: aa546abb-eaaa-4d5a-9cd6-9fa4ef15eb54 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:47.741402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-bccca0ba-cecc-45a4-b0f3-a21897fb4ff7 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (aa546abb-eaaa-4d5a-9cd6-9fa4ef15eb54), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:47.741721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-bccca0ba-cecc-45a4-b0f3-a21897fb4ff7 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Security group rule updated ['bfb86a56-b21b-42ad-94ac-a717aef8569c'] Sep 25 01:06:47.742264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-bccca0ba-cecc-45a4-b0f3-a21897fb4ff7 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Resource SecurityGroupRule deleted: 0ec64e4e-e64f-4379-94f2-7732f4f966bd {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:47.742776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-bccca0ba-cecc-45a4-b0f3-a21897fb4ff7 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (0ec64e4e-e64f-4379-94f2-7732f4f966bd), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:47.743114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-bccca0ba-cecc-45a4-b0f3-a21897fb4ff7 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Security group rule updated ['bfb86a56-b21b-42ad-94ac-a717aef8569c'] Sep 25 01:06:48.149567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-38e3c8e1-0b37-43e5-a36a-363d66125445 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Resource Port deleted: 84c0f85e-de10-4d63-ae1d-deab86b97883 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:48.150403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-38e3c8e1-0b37-43e5-a36a-363d66125445 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (84c0f85e-de10-4d63-ae1d-deab86b97883), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:48.316070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:578 started Sep 25 01:06:48.319481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1e1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=45000000,duration_sec=1171,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:48.320073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:06:48.320525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:578 - starting polling. Elapsed:0.005 Sep 25 01:06:48.322704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:48.324250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 84c0f85e-de10-4d63-ae1d-deab86b97883 not present in bridge br-int Sep 25 01:06:48.324587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:06:48.324873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['84c0f85e-de10-4d63-ae1d-deab86b97883'] Sep 25 01:06:48.325201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 84c0f85e-de10-4d63-ae1d-deab86b97883 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:06:48.328921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:578 - port information retrieved. Elapsed:0.013 Sep 25 01:06:48.329284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:578 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 25 01:06:48.491736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e898f956-87a8-4c05-8efd-b5e9bf991f6c tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:06:48Z,description='tempest-description--2104962051',id=9dd271a7-aab8-43be-b712-5800c366c617,is_default=False,name='tempest-securitygroup--1323704980',project_id='f37b53a21b19482b8dcac6c38505a50b',revision_number=1,rules=[SecurityGroupRule(12379009-0136-4440-94af-09905b22ad2f),SecurityGroupRule(c9836bdb-2374-4187-bd77-55b4a0ab42e0)],shared=False,stateful=True,updated_at=2022-09-25T01:06:48Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:06:48.492454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e898f956-87a8-4c05-8efd-b5e9bf991f6c tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (9dd271a7-aab8-43be-b712-5800c366c617), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:48.493215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e898f956-87a8-4c05-8efd-b5e9bf991f6c tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:06:48Z,description=,direction='egress',ethertype='IPv4',id=12379009-0136-4440-94af-09905b22ad2f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f37b53a21b19482b8dcac6c38505a50b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9dd271a7-aab8-43be-b712-5800c366c617,updated_at=2022-09-25T01:06:48Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:06:48.493711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e898f956-87a8-4c05-8efd-b5e9bf991f6c tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (12379009-0136-4440-94af-09905b22ad2f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:48.494256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-e898f956-87a8-4c05-8efd-b5e9bf991f6c tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Security group rule updated ['9dd271a7-aab8-43be-b712-5800c366c617'] Sep 25 01:06:48.495780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e898f956-87a8-4c05-8efd-b5e9bf991f6c tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:06:48Z,description=,direction='egress',ethertype='IPv6',id=c9836bdb-2374-4187-bd77-55b4a0ab42e0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f37b53a21b19482b8dcac6c38505a50b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9dd271a7-aab8-43be-b712-5800c366c617,updated_at=2022-09-25T01:06:48Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:06:48.496599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e898f956-87a8-4c05-8efd-b5e9bf991f6c tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (c9836bdb-2374-4187-bd77-55b4a0ab42e0), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:48.497179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-e898f956-87a8-4c05-8efd-b5e9bf991f6c tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Security group rule updated ['9dd271a7-aab8-43be-b712-5800c366c617'] Sep 25 01:06:48.645028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-14c26aa6-838d-429b-8bee-827932a88b36 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:06:48Z,description='',direction='ingress',ethertype='IPv4',id=2a65dc04-ee4a-4a26-be91-f5a760933bbf,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='f37b53a21b19482b8dcac6c38505a50b',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9dd271a7-aab8-43be-b712-5800c366c617,updated_at=2022-09-25T01:06:48Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:06:48.645477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-14c26aa6-838d-429b-8bee-827932a88b36 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (2a65dc04-ee4a-4a26-be91-f5a760933bbf), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:48.645827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-14c26aa6-838d-429b-8bee-827932a88b36 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Security group rule updated ['9dd271a7-aab8-43be-b712-5800c366c617'] Sep 25 01:06:48.808868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-14a7917b-6e25-465a-9eea-553bcd9cd1ad tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:06:48Z,description='',direction='ingress',ethertype='IPv4',id=e75ebef1-ba34-4a1a-9b2e-6126b251324a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f37b53a21b19482b8dcac6c38505a50b',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9dd271a7-aab8-43be-b712-5800c366c617,updated_at=2022-09-25T01:06:48Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:06:48.810018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-14a7917b-6e25-465a-9eea-553bcd9cd1ad tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (e75ebef1-ba34-4a1a-9b2e-6126b251324a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:48.810018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-14a7917b-6e25-465a-9eea-553bcd9cd1ad tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Security group rule updated ['9dd271a7-aab8-43be-b712-5800c366c617'] Sep 25 01:06:49.481394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d07dc758-6448-4d84-9d37-03f0b4fa6fd7 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:06:48Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=5128e5ec-d180-49f4-a582-08e4f07c3ed0,mac_address=fa:16:3e:c9:09:cd,name='',network_id=62195cd6-54fa-4e24-9d47-ae0de6356ac2,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(5128e5ec-d180-49f4-a582-08e4f07c3ed0),security_group_ids=set([]),status='N/A',updated_at=2022-09-25T01:06:49Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:06:49.482324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d07dc758-6448-4d84-9d37-03f0b4fa6fd7 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (5128e5ec-d180-49f4-a582-08e4f07c3ed0), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:50.080490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d07dc758-6448-4d84-9d37-03f0b4fa6fd7 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Resource Port 5128e5ec-d180-49f4-a582-08e4f07c3ed0 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'd5e93845-e1a3-42b9-8f4c-e53ae3d84997'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:06:50.081301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d07dc758-6448-4d84-9d37-03f0b4fa6fd7 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (5128e5ec-d180-49f4-a582-08e4f07c3ed0), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:50.317036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:579 started Sep 25 01:06:50.324772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1e3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=46000000,duration_sec=1173,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:50.325755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:06:50.327702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:579 - starting polling. Elapsed:0.011 Sep 25 01:06:50.333221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:50.336960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:579 - port information retrieved. Elapsed:0.020 Sep 25 01:06:50.337727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:579 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.021 Sep 25 01:06:52.318306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:580 started Sep 25 01:06:52.322224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1e5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=47000000,duration_sec=1175,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:52.323411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:06:52.324013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:580 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:06:52.583800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-dcef5f3d-fc5a-4ac7-aba7-b7f6764b8e7b tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Resource Port deleted: e648c726-bd59-4f54-9ff1-4c8597b65cff {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:52.584384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-dcef5f3d-fc5a-4ac7-aba7-b7f6764b8e7b tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (e648c726-bd59-4f54-9ff1-4c8597b65cff), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:54.319494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:581 started Sep 25 01:06:54.326910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1e7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=51000000,duration_sec=1177,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:54.328184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:06:54.329051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:581 - starting polling. Elapsed:0.010 Sep 25 01:06:54.333228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:54.336294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port e648c726-bd59-4f54-9ff1-4c8597b65cff not present in bridge br-int Sep 25 01:06:54.337107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:06:54.337685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['e648c726-bd59-4f54-9ff1-4c8597b65cff'] Sep 25 01:06:54.338534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port e648c726-bd59-4f54-9ff1-4c8597b65cff is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:06:54.345028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:581 - port information retrieved. Elapsed:0.025 Sep 25 01:06:54.346023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:581 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.027 Sep 25 01:06:54.753373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5298d37a-75c0-4e08-b287-a07200781d4d tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:06:53Z,data_plane_status=None,description='',device_id='a098f4d1-9c50-4e95-a5aa-e7cb07850ad4',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=1efe19b6-e801-45ed-8aac-c94c3a3e0758,mac_address=fa:16:3e:be:b8:28,name='',network_id=dbea2e08-a361-48c8-95fc-03b3fc326d51,numa_affinity_policy=,project_id='f37b53a21b19482b8dcac6c38505a50b',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(1efe19b6-e801-45ed-8aac-c94c3a3e0758),security_group_ids=set([9dd271a7-aab8-43be-b712-5800c366c617]),status='DOWN',updated_at=2022-09-25T01:06:54Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:06:54.753761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-5298d37a-75c0-4e08-b287-a07200781d4d tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (1efe19b6-e801-45ed-8aac-c94c3a3e0758), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:54.754272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-5298d37a-75c0-4e08-b287-a07200781d4d tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Security group member updated {'9dd271a7-aab8-43be-b712-5800c366c617'} Sep 25 01:06:56.234205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-867b7e43-4f0e-45a0-b8f4-445a11f4c079 service neutron] Resource Port 1efe19b6-e801-45ed-8aac-c94c3a3e0758 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=1efe19b6-e801-45ed-8aac-c94c3a3e0758,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=1efe19b6-e801-45ed-8aac-c94c3a3e0758,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:06:56.235786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-867b7e43-4f0e-45a0-b8f4-445a11f4c079 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (1efe19b6-e801-45ed-8aac-c94c3a3e0758), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:56.322266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:582 started Sep 25 01:06:56.333596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1e9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=56000000,duration_sec=1179,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:56.336934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:06:56.337866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:582 - starting polling. Elapsed:0.016 Sep 25 01:06:56.342315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:56.354045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:582 - port information retrieved. Elapsed:0.031 Sep 25 01:06:56.355788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:582 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.033 Sep 25 01:06:56.872482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2da7dec3-a58f-4f85-9bdc-b0074eacb64a tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Resource Port deleted: 7589db85-95c8-412c-a8f7-5db156ef7906 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:56.874969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2da7dec3-a58f-4f85-9bdc-b0074eacb64a tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (7589db85-95c8-412c-a8f7-5db156ef7906), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:56.875838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2da7dec3-a58f-4f85-9bdc-b0074eacb64a tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Security group member updated {'601e3316-8b17-4b11-acb6-e60b3d5c5c7f'} Sep 25 01:06:56.960720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-867b7e43-4f0e-45a0-b8f4-445a11f4c079 service neutron] Resource Port 1efe19b6-e801-45ed-8aac-c94c3a3e0758 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=1efe19b6-e801-45ed-8aac-c94c3a3e0758,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=1efe19b6-e801-45ed-8aac-c94c3a3e0758,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=1efe19b6-e801-45ed-8aac-c94c3a3e0758,segment=NetworkSegment(ed5ec111-24e0-4aad-b5c7-8fcadf6e28a3),segment_id=ed5ec111-24e0-4aad-b5c7-8fcadf6e28a3)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:06:56.968949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-867b7e43-4f0e-45a0-b8f4-445a11f4c079 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (1efe19b6-e801-45ed-8aac-c94c3a3e0758), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:58.324337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:583 started Sep 25 01:06:58.326976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1eb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=53000000,duration_sec=1181,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:06:58.327631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:06:58.328160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:583 - starting polling. Elapsed:0.004 Sep 25 01:06:58.330394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:58.331813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 7589db85-95c8-412c-a8f7-5db156ef7906 not present in bridge br-int Sep 25 01:06:58.332156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:06:58.332449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['7589db85-95c8-412c-a8f7-5db156ef7906'] Sep 25 01:06:58.332779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 7589db85-95c8-412c-a8f7-5db156ef7906 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:06:58.335478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:583 - port information retrieved. Elapsed:0.011 Sep 25 01:06:58.335816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:583 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 25 01:06:59.490593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a29c0426-520b-4185-8011-d4b40c880bd8 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Resource SecurityGroup deleted: 601e3316-8b17-4b11-acb6-e60b3d5c5c7f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:59.491803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a29c0426-520b-4185-8011-d4b40c880bd8 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (601e3316-8b17-4b11-acb6-e60b3d5c5c7f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:59.492330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a29c0426-520b-4185-8011-d4b40c880bd8 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('601e3316-8b17-4b11-acb6-e60b3d5c5c7f',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:06:59.517713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a29c0426-520b-4185-8011-d4b40c880bd8 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('601e3316-8b17-4b11-acb6-e60b3d5c5c7f',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:06:59.518778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a29c0426-520b-4185-8011-d4b40c880bd8 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Resource SecurityGroupRule deleted: 8ec55e35-c309-4245-bc61-87a575ef4bee {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:59.519593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a29c0426-520b-4185-8011-d4b40c880bd8 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (8ec55e35-c309-4245-bc61-87a575ef4bee), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:59.519973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a29c0426-520b-4185-8011-d4b40c880bd8 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Security group rule updated ['601e3316-8b17-4b11-acb6-e60b3d5c5c7f'] Sep 25 01:06:59.520409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a29c0426-520b-4185-8011-d4b40c880bd8 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Resource SecurityGroupRule deleted: f06a047f-41ad-4dc1-9a76-f0210dfd6f8d {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:59.520796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a29c0426-520b-4185-8011-d4b40c880bd8 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f06a047f-41ad-4dc1-9a76-f0210dfd6f8d), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:59.521148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a29c0426-520b-4185-8011-d4b40c880bd8 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Security group rule updated ['601e3316-8b17-4b11-acb6-e60b3d5c5c7f'] Sep 25 01:06:59.521773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a29c0426-520b-4185-8011-d4b40c880bd8 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Resource SecurityGroupRule deleted: 211f64c3-c314-4c9f-b3d1-ff23656dd576 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:59.522237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a29c0426-520b-4185-8011-d4b40c880bd8 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (211f64c3-c314-4c9f-b3d1-ff23656dd576), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:59.522597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a29c0426-520b-4185-8011-d4b40c880bd8 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Security group rule updated ['601e3316-8b17-4b11-acb6-e60b3d5c5c7f'] Sep 25 01:06:59.523009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a29c0426-520b-4185-8011-d4b40c880bd8 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Resource SecurityGroupRule deleted: ef795a18-98c0-4f10-9132-78c71f273f10 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:59.523389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a29c0426-520b-4185-8011-d4b40c880bd8 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (ef795a18-98c0-4f10-9132-78c71f273f10), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:59.523769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a29c0426-520b-4185-8011-d4b40c880bd8 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Security group rule updated ['601e3316-8b17-4b11-acb6-e60b3d5c5c7f'] Sep 25 01:06:59.524293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a29c0426-520b-4185-8011-d4b40c880bd8 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Resource SecurityGroupRule deleted: e6a4126b-f632-4bb4-b7d0-4dd4dd6eac9f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:59.524829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a29c0426-520b-4185-8011-d4b40c880bd8 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (e6a4126b-f632-4bb4-b7d0-4dd4dd6eac9f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:59.525388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a29c0426-520b-4185-8011-d4b40c880bd8 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Security group rule updated ['601e3316-8b17-4b11-acb6-e60b3d5c5c7f'] Sep 25 01:06:59.526356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a29c0426-520b-4185-8011-d4b40c880bd8 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Resource SecurityGroupRule deleted: ebac5701-43d3-4e9c-a318-3da173aa3042 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:59.527092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a29c0426-520b-4185-8011-d4b40c880bd8 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (ebac5701-43d3-4e9c-a318-3da173aa3042), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:59.527798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a29c0426-520b-4185-8011-d4b40c880bd8 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Security group rule updated ['601e3316-8b17-4b11-acb6-e60b3d5c5c7f'] Sep 25 01:06:59.528478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a29c0426-520b-4185-8011-d4b40c880bd8 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Resource SecurityGroupRule deleted: 68c09630-d5d2-43de-89c8-8d02767bece3 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:59.529073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a29c0426-520b-4185-8011-d4b40c880bd8 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (68c09630-d5d2-43de-89c8-8d02767bece3), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:59.529609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a29c0426-520b-4185-8011-d4b40c880bd8 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Security group rule updated ['601e3316-8b17-4b11-acb6-e60b3d5c5c7f'] Sep 25 01:06:59.530453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a29c0426-520b-4185-8011-d4b40c880bd8 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Resource SecurityGroupRule deleted: f4bbc97f-b8d5-4e40-acbc-615bbc4feee5 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:06:59.531001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a29c0426-520b-4185-8011-d4b40c880bd8 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f4bbc97f-b8d5-4e40-acbc-615bbc4feee5), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:06:59.531545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a29c0426-520b-4185-8011-d4b40c880bd8 tempest-TestShelveInstance-384141591 tempest-TestShelveInstance-384141591-project] Security group rule updated ['601e3316-8b17-4b11-acb6-e60b3d5c5c7f'] Sep 25 01:07:00.047755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 1efe19b6-e801-45ed-8aac-c94c3a3e0758 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:07:00.048327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (1efe19b6-e801-45ed-8aac-c94c3a3e0758), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:07:00.325570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:584 started Sep 25 01:07:00.332931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1ed,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=57000000,duration_sec=1183,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:00.333921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:07:00.334398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:584 - starting polling. Elapsed:0.009 Sep 25 01:07:00.336788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:07:00.340172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:584 - port information retrieved. Elapsed:0.015 Sep 25 01:07:00.340599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:584 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Sep 25 01:07:00.819901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c34fe1d7-1657-47bd-987f-7084649422cc admin admin] Resource Port deleted: d1013a6f-ee2d-46c6-9579-1abeb6086893 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:07:00.822351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c34fe1d7-1657-47bd-987f-7084649422cc admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (d1013a6f-ee2d-46c6-9579-1abeb6086893), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:07:02.264006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 1efe19b6-e801-45ed-8aac-c94c3a3e0758 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:07:02.265187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (1efe19b6-e801-45ed-8aac-c94c3a3e0758), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:07:02.328922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:585 started Sep 25 01:07:02.339238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1ef,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=60000000,duration_sec=1185,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:02.340820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:07:02.343009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:585 - starting polling. Elapsed:0.013 Sep 25 01:07:02.349811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:07:02.374861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-d1013a6f-ee, col_values=(('tag', 4095),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:07:02.393310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-71d6a309-ceec-41ef-b1be-bee0546ad854 admin admin] Resource Port deleted: c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:07:02.393687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-71d6a309-ceec-41ef-b1be-bee0546ad854 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:07:02.398621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e1f1,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 32}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:02.404574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-c78ccb6c-0f, col_values=(('tag', 4095),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:07:02.416279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["fb714898-a2fd-4ee0-bc94-a1ab9e64b4f1","delete","qr-d1013a6f-ee",32,["map",[["attached-mac","fa:16:3e:60:3d:46"],["iface-id","d1013a6f-ee2d-46c6-9579-1abeb6086893"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:07:02.729965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e1f3,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 31}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:02.730941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['d1013a6f-ee2d-46c6-9579-1abeb6086893'] Sep 25 01:07:02.731919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 4 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:07:02.793772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccc1340-4a53-4c9f-86fc-3a14bfe4cd70]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:07:02.804790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e1f5,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 32}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:02.805310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:585 - port information retrieved. Elapsed:0.477 Sep 25 01:07:02.806199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:585 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.477 Sep 25 01:07:02.868752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["1c908142-db11-4eab-9327-e018cb1a7113","delete","qg-c78ccb6c-0f",31,["map",[["attached-mac","fa:16:3e:11:dd:6b"],["iface-id","c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:07:03.177681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0bbd5714-eb6e-45d5-894c-2cae7981fd31 admin admin] Resource Subnet deleted: 3a3c28a1-4968-4492-967d-c258b7838096 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:07:03.179696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0bbd5714-eb6e-45d5-894c-2cae7981fd31 admin admin] Publish callbacks [] for Subnet (3a3c28a1-4968-4492-967d-c258b7838096), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:07:03.404299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a8d6e2fb-9911-45b6-a46a-3d218a5c7b9b","delete","tapd18a3c48-8b",30,["map",[["attached-mac","fa:16:3e:61:db:45"],["iface-id","d18a3c48-8be7-45c0-8641-dd3182b273bc"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:07:03.686735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2974431d-c19b-497b-a55e-24c55e5e0668 admin admin] Resource Port deleted: d18a3c48-8be7-45c0-8641-dd3182b273bc {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:07:03.691342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2974431d-c19b-497b-a55e-24c55e5e0668 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (d18a3c48-8be7-45c0-8641-dd3182b273bc), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:07:03.827438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5c91f754-916b-4271-8fb9-57981011761e None None] Resource Port deleted: d18a3c48-8be7-45c0-8641-dd3182b273bc {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:07:03.827964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-5c91f754-916b-4271-8fb9-57981011761e None None] Skipped duplicate delete event for d18a3c48-8be7-45c0-8641-dd3182b273bc {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 25 01:07:04.103443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2974431d-c19b-497b-a55e-24c55e5e0668 admin admin] Resource Network deleted: c62c61a7-64ad-4bd4-8ce7-b21b978664a6 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:07:04.103808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2974431d-c19b-497b-a55e-24c55e5e0668 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (c62c61a7-64ad-4bd4-8ce7-b21b978664a6), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:07:04.330307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:586 started Sep 25 01:07:04.335100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1f7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=60000000,duration_sec=1187,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:04.336712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:07:04.337646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:586 - starting polling. Elapsed:0.008 Sep 25 01:07:04.343240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:07:04.350751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e1f9,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 30}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:04.353709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e1fb,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 31}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:04.354321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:586 - port information retrieved. Elapsed:0.024 Sep 25 01:07:04.354921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'41a4501b-2acb-4e3d-a37d-bedbcdc6c76d', '0feb7341-0637-4360-9832-808376ee9e2a', '2f0cdd80-0129-4756-a061-a2bfb559e884', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', 'dc092d9f-c63d-420c-8856-ecb381597fd7', 'de4727a2-569d-44c6-a53e-ecc89817f610', '5204c0c3-4410-4695-a405-b599292c4e80', '71ee88f3-d4ca-4676-ab1f-7494784204fa', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '025c4caf-135a-4da4-9e95-24f950bedb8b'}, 'added': set(), 'removed': {'d18a3c48-8be7-45c0-8641-dd3182b273bc', 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92'}, 'updated': set(), 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:07:04.355698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:586 - agent port security group processed in 0.000 Sep 25 01:07:04.359242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up [] and devices down [] completed. Sep 25 01:07:04.359717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for {'d18a3c48-8be7-45c0-8641-dd3182b273bc', 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92'} Sep 25 01:07:04.360367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port d1013a6f-ee2d-46c6-9579-1abeb6086893 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:07:04.361090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 8 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:07:04.413839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[967b289f-ef9a-4719-afe7-bfbfcd1b67bf]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:07:04.415603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Ports {'d18a3c48-8be7-45c0-8641-dd3182b273bc', 'd1013a6f-ee2d-46c6-9579-1abeb6086893', 'c78ccb6c-0f3e-44a5-bf22-9f8e1a8ebd92'} removed Sep 25 01:07:04.502043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port removal failed for set() {{(pid=107261) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 25 01:07:04.502611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Reclaiming vlan = 12 from net-id = c62c61a7-64ad-4bd4-8ce7-b21b978664a6, seg-id = 98 Sep 25 01:07:04.511363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xa5d7ab62,OFPFlowMod(buffer_id=4294967295,command=3,cookie=13979250796582379444,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4108}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:04.513822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x7834e1fd,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4194}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:04.514378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:07:04.514948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:07:04.515398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:586 - treat_devices_removed completed in 0.156 Sep 25 01:07:04.515865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:586 - ports processed. Elapsed:0.186 Sep 25 01:07:04.516196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:586 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.186 Sep 25 01:07:06.012576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f23de809-5357-4a9b-a8de-429a66ddb007 admin admin] Resource Port deleted: dc092d9f-c63d-420c-8856-ecb381597fd7 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:07:06.014080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f23de809-5357-4a9b-a8de-429a66ddb007 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (dc092d9f-c63d-420c-8856-ecb381597fd7), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:07:06.331706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:587 started Sep 25 01:07:06.337707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e1ff,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=61000000,duration_sec=1189,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:06.338872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:07:06.339661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:587 - starting polling. Elapsed:0.008 Sep 25 01:07:06.345198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:07:06.351367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-dc092d9f-c6, col_values=(('tag', 4095),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:07:06.366564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e201,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 34}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:06.368101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['dc092d9f-c63d-420c-8856-ecb381597fd7'] Sep 25 01:07:06.369241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 4 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:07:06.445082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8853f83d-615c-431d-9d5a-18179ae01e40]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:07:06.448231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:587 - port information retrieved. Elapsed:0.117 Sep 25 01:07:06.448568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:587 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.117 Sep 25 01:07:07.282222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["547f05b0-1f3e-4fd6-a256-8b960db149b4","delete","qr-dc092d9f-c6",34,["map",[["attached-mac","fa:16:3e:c2:18:99"],["iface-id","dc092d9f-c63d-420c-8856-ecb381597fd7"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:07:07.334066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6b98750a-3f3e-40aa-b585-fd7487bbcbeb admin admin] Resource Port deleted: 41a4501b-2acb-4e3d-a37d-bedbcdc6c76d {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:07:07.334649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6b98750a-3f3e-40aa-b585-fd7487bbcbeb admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (41a4501b-2acb-4e3d-a37d-bedbcdc6c76d), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:07:07.778161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["164661bd-0078-407f-875a-fdcca48ddfa8","delete","qg-41a4501b-2a",35,["map",[["attached-mac","fa:16:3e:9d:76:4c"],["iface-id","41a4501b-2acb-4e3d-a37d-bedbcdc6c76d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:07:08.006501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-626a5f3c-e105-469c-a139-b7a9b88e7d20 admin admin] Resource Subnet deleted: 8411f93b-86a3-4016-8215-1e4f10f0027b {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:07:08.009587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-626a5f3c-e105-469c-a139-b7a9b88e7d20 admin admin] Publish callbacks [] for Subnet (8411f93b-86a3-4016-8215-1e4f10f0027b), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:07:08.333078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:588 started Sep 25 01:07:08.338624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e203,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=62000000,duration_sec=1191,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:08.346860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:07:08.349121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:588 - starting polling. Elapsed:0.016 Sep 25 01:07:08.359539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:07:08.381662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0232eb92-aef9-471e-b0f4-08e782f45189","delete","tap71ee88f3-d4",33,["map",[["attached-mac","fa:16:3e:54:18:4f"],["iface-id","71ee88f3-d4ca-4676-ab1f-7494784204fa"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:07:08.416018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e205,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 34}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:08.421082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e207,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 35}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:08.422212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:588 - port information retrieved. Elapsed:0.089 Sep 25 01:07:08.423102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'0feb7341-0637-4360-9832-808376ee9e2a', '2f0cdd80-0129-4756-a061-a2bfb559e884', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', 'de4727a2-569d-44c6-a53e-ecc89817f610', '5204c0c3-4410-4695-a405-b599292c4e80', '71ee88f3-d4ca-4676-ab1f-7494784204fa', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '025c4caf-135a-4da4-9e95-24f950bedb8b'}, 'added': set(), 'removed': {'41a4501b-2acb-4e3d-a37d-bedbcdc6c76d', 'dc092d9f-c63d-420c-8856-ecb381597fd7'}, 'updated': set(), 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:07:08.423868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:588 - agent port security group processed in 0.000 Sep 25 01:07:08.428738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up [] and devices down [] completed. Sep 25 01:07:08.429836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for {'41a4501b-2acb-4e3d-a37d-bedbcdc6c76d', 'dc092d9f-c63d-420c-8856-ecb381597fd7'} Sep 25 01:07:08.430803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port dc092d9f-c63d-420c-8856-ecb381597fd7 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:07:08.432198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 4 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:07:08.512233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d784e5d0-68db-44ca-a541-5337bf53bea5]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:07:08.514126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Ports {'41a4501b-2acb-4e3d-a37d-bedbcdc6c76d', 'dc092d9f-c63d-420c-8856-ecb381597fd7'} removed Sep 25 01:07:08.670616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3db104b0-697f-4f42-8986-9401d715149d admin admin] Resource Port deleted: 71ee88f3-d4ca-4676-ab1f-7494784204fa {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:07:08.671296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3db104b0-697f-4f42-8986-9401d715149d admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (71ee88f3-d4ca-4676-ab1f-7494784204fa), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:07:08.675979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port removal failed for set() {{(pid=107261) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 25 01:07:08.676415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:07:08.676949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:588 - treat_devices_removed completed in 0.247 Sep 25 01:07:08.677231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:588 - ports processed. Elapsed:0.345 Sep 25 01:07:08.677776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:588 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.345 Sep 25 01:07:08.951637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9f9c26f3-43b8-42f4-9aed-fa65f7f74e2f None None] Resource Port deleted: 71ee88f3-d4ca-4676-ab1f-7494784204fa {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:07:08.957861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9f9c26f3-43b8-42f4-9aed-fa65f7f74e2f None None] Skipped duplicate delete event for 71ee88f3-d4ca-4676-ab1f-7494784204fa {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 25 01:07:09.063819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3db104b0-697f-4f42-8986-9401d715149d admin admin] Resource Network deleted: 09798d2d-0271-466c-9c29-d981c8d4721a {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:07:09.064373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3db104b0-697f-4f42-8986-9401d715149d admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (09798d2d-0271-466c-9c29-d981c8d4721a), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:07:09.555134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-313d38f4-b601-4552-a0cc-ca674e558fc2 admin admin] Resource SecurityGroup deleted: e05b15b2-3672-49c0-a490-1e2728c4b3e0 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:07:09.556125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-313d38f4-b601-4552-a0cc-ca674e558fc2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (e05b15b2-3672-49c0-a490-1e2728c4b3e0), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:07:09.556125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-313d38f4-b601-4552-a0cc-ca674e558fc2 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e05b15b2-3672-49c0-a490-1e2728c4b3e0',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:07:09.578061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-313d38f4-b601-4552-a0cc-ca674e558fc2 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e05b15b2-3672-49c0-a490-1e2728c4b3e0',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:07:09.578900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-313d38f4-b601-4552-a0cc-ca674e558fc2 admin admin] Resource SecurityGroupRule deleted: 043508f3-851f-4bb7-b1ab-ef4963eca3b4 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:07:09.579513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-313d38f4-b601-4552-a0cc-ca674e558fc2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (043508f3-851f-4bb7-b1ab-ef4963eca3b4), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:07:09.580079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-313d38f4-b601-4552-a0cc-ca674e558fc2 admin admin] Security group rule updated ['e05b15b2-3672-49c0-a490-1e2728c4b3e0'] Sep 25 01:07:09.580547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-313d38f4-b601-4552-a0cc-ca674e558fc2 admin admin] Resource SecurityGroupRule deleted: 5a041836-bd29-455d-9e18-4587e5da41be {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:07:09.580964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-313d38f4-b601-4552-a0cc-ca674e558fc2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (5a041836-bd29-455d-9e18-4587e5da41be), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:07:09.581459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-313d38f4-b601-4552-a0cc-ca674e558fc2 admin admin] Security group rule updated ['e05b15b2-3672-49c0-a490-1e2728c4b3e0'] Sep 25 01:07:09.581875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-313d38f4-b601-4552-a0cc-ca674e558fc2 admin admin] Resource SecurityGroupRule deleted: c4f8c7ba-716d-4b7c-ad6e-af682f79098f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:07:09.582296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-313d38f4-b601-4552-a0cc-ca674e558fc2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (c4f8c7ba-716d-4b7c-ad6e-af682f79098f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:07:09.582813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-313d38f4-b601-4552-a0cc-ca674e558fc2 admin admin] Security group rule updated ['e05b15b2-3672-49c0-a490-1e2728c4b3e0'] Sep 25 01:07:09.583517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-313d38f4-b601-4552-a0cc-ca674e558fc2 admin admin] Resource SecurityGroupRule deleted: fbb5ae32-1356-4f31-893a-44fb714edfb7 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:07:09.584080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-313d38f4-b601-4552-a0cc-ca674e558fc2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (fbb5ae32-1356-4f31-893a-44fb714edfb7), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:07:09.584467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-313d38f4-b601-4552-a0cc-ca674e558fc2 admin admin] Security group rule updated ['e05b15b2-3672-49c0-a490-1e2728c4b3e0'] Sep 25 01:07:10.227561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ab07c5e1-7afb-44ab-852f-02580954052a admin admin] Resource SecurityGroup deleted: da9886cd-bb3e-42c0-a6f1-6b10fccce334 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:07:10.227941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ab07c5e1-7afb-44ab-852f-02580954052a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (da9886cd-bb3e-42c0-a6f1-6b10fccce334), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:07:10.228859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab07c5e1-7afb-44ab-852f-02580954052a admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('da9886cd-bb3e-42c0-a6f1-6b10fccce334',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:07:10.250929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ab07c5e1-7afb-44ab-852f-02580954052a admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('da9886cd-bb3e-42c0-a6f1-6b10fccce334',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:07:10.251463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ab07c5e1-7afb-44ab-852f-02580954052a admin admin] Resource SecurityGroupRule deleted: 48d5056e-8433-413e-8245-1764cd4bd1b9 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:07:10.251945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ab07c5e1-7afb-44ab-852f-02580954052a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (48d5056e-8433-413e-8245-1764cd4bd1b9), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:07:10.252687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ab07c5e1-7afb-44ab-852f-02580954052a admin admin] Security group rule updated ['da9886cd-bb3e-42c0-a6f1-6b10fccce334'] Sep 25 01:07:10.253229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ab07c5e1-7afb-44ab-852f-02580954052a admin admin] Resource SecurityGroupRule deleted: 551fbaa8-0704-4080-91cb-0a9b046104d2 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:07:10.253737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ab07c5e1-7afb-44ab-852f-02580954052a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (551fbaa8-0704-4080-91cb-0a9b046104d2), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:07:10.254324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ab07c5e1-7afb-44ab-852f-02580954052a admin admin] Security group rule updated ['da9886cd-bb3e-42c0-a6f1-6b10fccce334'] Sep 25 01:07:10.254833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ab07c5e1-7afb-44ab-852f-02580954052a admin admin] Resource SecurityGroupRule deleted: 96bd6248-e739-42a5-8f1e-0aeeadab8f68 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:07:10.255230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ab07c5e1-7afb-44ab-852f-02580954052a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (96bd6248-e739-42a5-8f1e-0aeeadab8f68), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:07:10.255597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ab07c5e1-7afb-44ab-852f-02580954052a admin admin] Security group rule updated ['da9886cd-bb3e-42c0-a6f1-6b10fccce334'] Sep 25 01:07:10.256246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ab07c5e1-7afb-44ab-852f-02580954052a admin admin] Resource SecurityGroupRule deleted: a4feb820-9dfa-48e0-9d67-dd0c3c220ee1 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:07:10.256660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ab07c5e1-7afb-44ab-852f-02580954052a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (a4feb820-9dfa-48e0-9d67-dd0c3c220ee1), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:07:10.257036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ab07c5e1-7afb-44ab-852f-02580954052a admin admin] Security group rule updated ['da9886cd-bb3e-42c0-a6f1-6b10fccce334'] Sep 25 01:07:10.333673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:589 started Sep 25 01:07:10.336558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e209,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=62000000,duration_sec=1193,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:10.337738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:07:10.338559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:589 - starting polling. Elapsed:0.005 Sep 25 01:07:10.340709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:07:10.347680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e20b,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 33}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:10.348732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:589 - port information retrieved. Elapsed:0.015 Sep 25 01:07:10.349182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'0feb7341-0637-4360-9832-808376ee9e2a', '2f0cdd80-0129-4756-a061-a2bfb559e884', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', 'de4727a2-569d-44c6-a53e-ecc89817f610', '5204c0c3-4410-4695-a405-b599292c4e80', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '025c4caf-135a-4da4-9e95-24f950bedb8b'}, 'added': set(), 'removed': {'71ee88f3-d4ca-4676-ab1f-7494784204fa'}, 'updated': set(), 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:07:10.349740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:589 - agent port security group processed in 0.000 Sep 25 01:07:10.351654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up [] and devices down [] completed. Sep 25 01:07:10.352133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for {'71ee88f3-d4ca-4676-ab1f-7494784204fa'} Sep 25 01:07:10.352923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 4 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:07:10.406762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c646ac37-6bf0-453c-87bd-ce42623c2c08]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:07:10.408507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Ports {'71ee88f3-d4ca-4676-ab1f-7494784204fa'} removed Sep 25 01:07:10.462139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port removal failed for set() {{(pid=107261) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 25 01:07:10.462792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Reclaiming vlan = 13 from net-id = 09798d2d-0271-466c-9c29-d981c8d4721a, seg-id = 70 Sep 25 01:07:10.468697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xa5d7ab64,OFPFlowMod(buffer_id=4294967295,command=3,cookie=13979250796582379444,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4109}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:10.473877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x7834e20d,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4166}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:10.474413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:589 - treat_devices_removed completed in 0.122 Sep 25 01:07:10.474888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:589 - ports processed. Elapsed:0.141 Sep 25 01:07:10.475339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:589 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.142 Sep 25 01:07:12.334749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:590 started Sep 25 01:07:12.337640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e20f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=63000000,duration_sec=1195,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:12.338227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:07:12.338584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:590 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:07:14.335994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:591 started Sep 25 01:07:14.338891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e211,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=64000000,duration_sec=1197,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:14.339513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:07:14.339875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:591 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:07:16.337333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:592 started Sep 25 01:07:16.340217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e213,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=66000000,duration_sec=1199,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:16.340837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:07:16.341245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:592 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:07:18.338240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:593 started Sep 25 01:07:18.341094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e215,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=67000000,duration_sec=1201,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:18.341978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:07:18.342409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:593 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:07:20.339251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:594 started Sep 25 01:07:20.342463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e217,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=68000000,duration_sec=1203,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:20.343074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:07:20.343465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:594 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:07:22.340051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:595 started Sep 25 01:07:22.342826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e219,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=68000000,duration_sec=1205,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:22.343447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:07:22.343841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:595 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:07:24.341952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:596 started Sep 25 01:07:24.344882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e21b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=71000000,duration_sec=1207,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:24.345500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:07:24.345859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:596 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:07:26.342800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:597 started Sep 25 01:07:26.345957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e21d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=72000000,duration_sec=1209,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:26.346646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:07:26.347087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:597 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:07:28.343389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:598 started Sep 25 01:07:28.346373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e21f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=72000000,duration_sec=1211,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:28.347092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:07:28.347515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:598 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:07:30.344384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:599 started Sep 25 01:07:30.346925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e221,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=73000000,duration_sec=1213,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:30.347555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:07:30.347995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:599 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:07:32.345872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:600 started Sep 25 01:07:32.348612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e223,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=74000000,duration_sec=1215,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:32.349211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:07:32.349596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:600 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:07:34.347468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:601 started Sep 25 01:07:34.350170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e225,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=76000000,duration_sec=1217,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:34.350788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:07:34.351175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:601 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:07:36.348435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:602 started Sep 25 01:07:36.351060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e227,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=77000000,duration_sec=1219,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:36.351676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:07:36.352032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:602 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:07:38.349165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:603 started Sep 25 01:07:38.352111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e229,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=78000000,duration_sec=1221,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:38.352779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:07:38.353221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:603 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:07:40.350561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:604 started Sep 25 01:07:40.353573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e22b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=79000000,duration_sec=1223,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:40.354348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:07:40.354803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:604 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:07:42.351084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:605 started Sep 25 01:07:42.353707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e22d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=80000000,duration_sec=1225,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:42.354475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:07:42.354947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:605 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:07:44.353275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:606 started Sep 25 01:07:44.357831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e22f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=82000000,duration_sec=1227,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:44.358578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:07:44.359101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:606 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:07:46.354079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:607 started Sep 25 01:07:46.357543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e231,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=83000000,duration_sec=1229,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:46.358773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:07:46.359123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:607 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:07:48.355176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:608 started Sep 25 01:07:48.358824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e233,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=84000000,duration_sec=1231,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:48.359477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:07:48.359868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:608 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:07:50.356582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:609 started Sep 25 01:07:50.359491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e235,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=85000000,duration_sec=1233,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:50.360168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:07:50.360563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:609 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:07:52.357855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:610 started Sep 25 01:07:52.363325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e237,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=87000000,duration_sec=1235,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:52.364276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:07:52.364839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:610 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 01:07:54.358953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:611 started Sep 25 01:07:54.361860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e239,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=88000000,duration_sec=1237,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:54.362719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:07:54.363106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:611 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:07:56.359503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:612 started Sep 25 01:07:56.363339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e23b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=88000000,duration_sec=1239,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:56.364119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:07:56.364527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:612 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:07:58.360610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:613 started Sep 25 01:07:58.363986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e23d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=89000000,duration_sec=1241,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:07:58.365325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:07:58.365877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:613 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:08:00.361481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:614 started Sep 25 01:08:00.364968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e23f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=91000000,duration_sec=1243,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:00.365744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:08:00.366194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:614 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:08:02.362785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:615 started Sep 25 01:08:02.366331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e241,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=92000000,duration_sec=1245,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:02.366977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:08:02.367466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:615 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:08:04.363404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:616 started Sep 25 01:08:04.367803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e243,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=92000000,duration_sec=1247,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:04.368574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:08:04.369151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:616 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:08:06.364794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:617 started Sep 25 01:08:06.368754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e245,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=94000000,duration_sec=1249,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:06.370186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:08:06.370692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:617 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:08:08.365369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:618 started Sep 25 01:08:08.368702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e247,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=94000000,duration_sec=1251,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:08.369509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:08:08.369963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:618 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:08:09.054335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-79578f42-d7b5-4434-b805-d1ea7aea0afe tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Resource Port deleted: 1efe19b6-e801-45ed-8aac-c94c3a3e0758 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:09.055450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-79578f42-d7b5-4434-b805-d1ea7aea0afe tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (1efe19b6-e801-45ed-8aac-c94c3a3e0758), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:09.056810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-79578f42-d7b5-4434-b805-d1ea7aea0afe tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Security group member updated {'9dd271a7-aab8-43be-b712-5800c366c617'} Sep 25 01:08:10.366497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:619 started Sep 25 01:08:10.370251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e249,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=95000000,duration_sec=1253,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:10.371140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:08:10.372342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:619 - starting polling. Elapsed:0.006 Sep 25 01:08:10.374586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:10.375776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 1efe19b6-e801-45ed-8aac-c94c3a3e0758 not present in bridge br-int Sep 25 01:08:10.376275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:08:10.376686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['1efe19b6-e801-45ed-8aac-c94c3a3e0758'] Sep 25 01:08:10.377341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 1efe19b6-e801-45ed-8aac-c94c3a3e0758 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:08:10.379508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:619 - port information retrieved. Elapsed:0.013 Sep 25 01:08:10.379951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:619 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 25 01:08:11.353245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6bcc6ef1-5f79-4c77-9a1a-ab130550d671 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Resource SecurityGroup deleted: 9dd271a7-aab8-43be-b712-5800c366c617 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:11.353975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6bcc6ef1-5f79-4c77-9a1a-ab130550d671 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (9dd271a7-aab8-43be-b712-5800c366c617), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:11.355354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bcc6ef1-5f79-4c77-9a1a-ab130550d671 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('9dd271a7-aab8-43be-b712-5800c366c617',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:08:11.376788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6bcc6ef1-5f79-4c77-9a1a-ab130550d671 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('9dd271a7-aab8-43be-b712-5800c366c617',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:08:11.377744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6bcc6ef1-5f79-4c77-9a1a-ab130550d671 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Resource SecurityGroupRule deleted: 12379009-0136-4440-94af-09905b22ad2f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:11.377744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6bcc6ef1-5f79-4c77-9a1a-ab130550d671 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (12379009-0136-4440-94af-09905b22ad2f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:11.378094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-6bcc6ef1-5f79-4c77-9a1a-ab130550d671 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Security group rule updated ['9dd271a7-aab8-43be-b712-5800c366c617'] Sep 25 01:08:11.378318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6bcc6ef1-5f79-4c77-9a1a-ab130550d671 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Resource SecurityGroupRule deleted: c9836bdb-2374-4187-bd77-55b4a0ab42e0 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:11.378680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6bcc6ef1-5f79-4c77-9a1a-ab130550d671 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (c9836bdb-2374-4187-bd77-55b4a0ab42e0), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:11.379008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-6bcc6ef1-5f79-4c77-9a1a-ab130550d671 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Security group rule updated ['9dd271a7-aab8-43be-b712-5800c366c617'] Sep 25 01:08:11.379388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6bcc6ef1-5f79-4c77-9a1a-ab130550d671 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Resource SecurityGroupRule deleted: 2a65dc04-ee4a-4a26-be91-f5a760933bbf {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:11.379813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6bcc6ef1-5f79-4c77-9a1a-ab130550d671 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (2a65dc04-ee4a-4a26-be91-f5a760933bbf), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:11.380140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-6bcc6ef1-5f79-4c77-9a1a-ab130550d671 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Security group rule updated ['9dd271a7-aab8-43be-b712-5800c366c617'] Sep 25 01:08:11.380519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6bcc6ef1-5f79-4c77-9a1a-ab130550d671 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Resource SecurityGroupRule deleted: e75ebef1-ba34-4a1a-9b2e-6126b251324a {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:11.380872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6bcc6ef1-5f79-4c77-9a1a-ab130550d671 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (e75ebef1-ba34-4a1a-9b2e-6126b251324a), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:11.381194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-6bcc6ef1-5f79-4c77-9a1a-ab130550d671 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Security group rule updated ['9dd271a7-aab8-43be-b712-5800c366c617'] Sep 25 01:08:11.851809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-80a67f19-2b8d-456e-bebd-02b2f73a99d1 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Resource Port deleted: 5128e5ec-d180-49f4-a582-08e4f07c3ed0 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:11.852388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-80a67f19-2b8d-456e-bebd-02b2f73a99d1 tempest-AttachVolumeTestJSON-105378569 tempest-AttachVolumeTestJSON-105378569-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (5128e5ec-d180-49f4-a582-08e4f07c3ed0), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:12.367917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:620 started Sep 25 01:08:12.370769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e24b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=96000000,duration_sec=1255,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:12.371661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:08:12.372757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:620 - starting polling. Elapsed:0.004 Sep 25 01:08:12.374005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:12.374609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 5128e5ec-d180-49f4-a582-08e4f07c3ed0 not present in bridge br-int Sep 25 01:08:12.374946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:08:12.375295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['5128e5ec-d180-49f4-a582-08e4f07c3ed0'] Sep 25 01:08:12.375689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 5128e5ec-d180-49f4-a582-08e4f07c3ed0 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:08:12.377642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:620 - port information retrieved. Elapsed:0.010 Sep 25 01:08:12.378733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:620 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 25 01:08:14.372154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:621 started Sep 25 01:08:14.372154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e24d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=97000000,duration_sec=1257,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:14.376141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:08:14.376141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:621 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:08:16.369892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:622 started Sep 25 01:08:16.374007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e24f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=98000000,duration_sec=1259,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:16.374702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:08:16.375107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:622 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:08:16.619081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7aeedc13-d752-4569-9057-da54db0ddce0 admin admin] Resource Port deleted: 2f0cdd80-0129-4756-a061-a2bfb559e884 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:16.619687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7aeedc13-d752-4569-9057-da54db0ddce0 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (2f0cdd80-0129-4756-a061-a2bfb559e884), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:18.281236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["4fe37f04-0a1c-40fa-91d9-0575901263b0","delete","qr-2f0cdd80-01",37,["map",[["attached-mac","fa:16:3e:b2:6f:aa"],["iface-id","2f0cdd80-0129-4756-a061-a2bfb559e884"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:08:18.303426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-997711b3-c9e4-4485-9e35-8270f3af9772 admin admin] Resource Port deleted: 0feb7341-0637-4360-9832-808376ee9e2a {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:18.304054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-997711b3-c9e4-4485-9e35-8270f3af9772 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (0feb7341-0637-4360-9832-808376ee9e2a), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:18.371332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:623 started Sep 25 01:08:18.592378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e251,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=310000000,duration_sec=1261,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:18.593592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:08:18.595030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:623 - starting polling. Elapsed:0.223 Sep 25 01:08:18.597389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:18.602316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-0feb7341-06, col_values=(('tag', 4095),)) {{(pid=107261) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 25 01:08:18.619170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e253,OFPFlowMod(buffer_id=4294967295,command=0,cookie=5543098084362340806,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 38}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:18.619822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['0feb7341-0637-4360-9832-808376ee9e2a'] Sep 25 01:08:18.620553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 4 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:08:18.691627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8baa209-d088-40d3-81fb-18746ce8008f]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:08:18.700491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e255,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 37}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:18.700857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:623 - port information retrieved. Elapsed:0.330 Sep 25 01:08:18.701409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'0feb7341-0637-4360-9832-808376ee9e2a', 'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', 'de4727a2-569d-44c6-a53e-ecc89817f610', '5204c0c3-4410-4695-a405-b599292c4e80', 'fa672580-39eb-4bef-ac5b-6be835c6c88c', '025c4caf-135a-4da4-9e95-24f950bedb8b'}, 'added': set(), 'removed': {'2f0cdd80-0129-4756-a061-a2bfb559e884'}, 'updated': set(), 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:08:18.701861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:623 - agent port security group processed in 0.000 Sep 25 01:08:18.704064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up [] and devices down [] completed. Sep 25 01:08:18.704519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for {'2f0cdd80-0129-4756-a061-a2bfb559e884'} Sep 25 01:08:18.705214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 4 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:08:18.743595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["f8e1e993-6abf-4cda-9087-69b4ee72064c","delete","qg-0feb7341-06",38,["map",[["attached-mac","fa:16:3e:b7:67:2f"],["iface-id","0feb7341-0637-4360-9832-808376ee9e2a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:08:18.949854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a94394d6-85e8-4881-ae95-4ec72e0e53e2 admin admin] Resource Subnet deleted: 2e1050b6-9f20-4f3d-a5dc-be57c6013353 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:18.950395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a94394d6-85e8-4881-ae95-4ec72e0e53e2 admin admin] Publish callbacks [] for Subnet (2e1050b6-9f20-4f3d-a5dc-be57c6013353), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:19.097141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d441406-b8f0-4e7e-8207-3b90ab420282]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:08:19.098452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Ports {'2f0cdd80-0129-4756-a061-a2bfb559e884'} removed Sep 25 01:08:19.144973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port removal failed for set() {{(pid=107261) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 25 01:08:19.145705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:623 - treat_devices_removed completed in 0.441 Sep 25 01:08:19.146402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:623 - ports processed. Elapsed:0.775 Sep 25 01:08:19.146933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:623 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.776 Sep 25 01:08:19.157376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["8656d1a0-5e76-41c3-895c-d07aad33f90e","delete","tap025c4caf-13",36,["map",[["attached-mac","fa:16:3e:c2:fb:36"],["iface-id","025c4caf-135a-4da4-9e95-24f950bedb8b"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=107261) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 25 01:08:19.471430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e3a997f7-ea6f-4d8c-a2d9-d9454d61f008 admin admin] Resource Port deleted: 025c4caf-135a-4da4-9e95-24f950bedb8b {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:19.472485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e3a997f7-ea6f-4d8c-a2d9-d9454d61f008 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (025c4caf-135a-4da4-9e95-24f950bedb8b), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:19.596181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-478a35b4-1d95-4f40-83eb-fcfa0ef70c9b None None] Resource Port deleted: 025c4caf-135a-4da4-9e95-24f950bedb8b {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:19.596769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-478a35b4-1d95-4f40-83eb-fcfa0ef70c9b None None] Skipped duplicate delete event for 025c4caf-135a-4da4-9e95-24f950bedb8b {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 25 01:08:19.796694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e3a997f7-ea6f-4d8c-a2d9-d9454d61f008 admin admin] Resource Network deleted: dbea2e08-a361-48c8-95fc-03b3fc326d51 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:19.797617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e3a997f7-ea6f-4d8c-a2d9-d9454d61f008 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (dbea2e08-a361-48c8-95fc-03b3fc326d51), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:20.230886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f3510d14-6b74-44d4-a1b7-b9c6e55ca88c admin admin] Resource SecurityGroup deleted: c3bddf5a-82c0-4c2c-acbf-b783c9d5563e {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:20.231461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f3510d14-6b74-44d4-a1b7-b9c6e55ca88c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (c3bddf5a-82c0-4c2c-acbf-b783c9d5563e), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:20.232062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3510d14-6b74-44d4-a1b7-b9c6e55ca88c admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c3bddf5a-82c0-4c2c-acbf-b783c9d5563e',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:08:20.251111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f3510d14-6b74-44d4-a1b7-b9c6e55ca88c admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c3bddf5a-82c0-4c2c-acbf-b783c9d5563e',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:08:20.251651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f3510d14-6b74-44d4-a1b7-b9c6e55ca88c admin admin] Resource SecurityGroupRule deleted: 18c0d699-02d5-4dd8-8f20-9a0f5ecbc858 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:20.252101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f3510d14-6b74-44d4-a1b7-b9c6e55ca88c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (18c0d699-02d5-4dd8-8f20-9a0f5ecbc858), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:20.252528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f3510d14-6b74-44d4-a1b7-b9c6e55ca88c admin admin] Security group rule updated ['c3bddf5a-82c0-4c2c-acbf-b783c9d5563e'] Sep 25 01:08:20.253060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f3510d14-6b74-44d4-a1b7-b9c6e55ca88c admin admin] Resource SecurityGroupRule deleted: 26b70770-3252-4113-a63e-d73ae23a2404 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:20.253529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f3510d14-6b74-44d4-a1b7-b9c6e55ca88c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (26b70770-3252-4113-a63e-d73ae23a2404), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:20.254551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f3510d14-6b74-44d4-a1b7-b9c6e55ca88c admin admin] Security group rule updated ['c3bddf5a-82c0-4c2c-acbf-b783c9d5563e'] Sep 25 01:08:20.255055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f3510d14-6b74-44d4-a1b7-b9c6e55ca88c admin admin] Resource SecurityGroupRule deleted: 7af5d1e7-6404-426b-b19f-6b2813ea44af {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:20.255550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f3510d14-6b74-44d4-a1b7-b9c6e55ca88c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (7af5d1e7-6404-426b-b19f-6b2813ea44af), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:20.255900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f3510d14-6b74-44d4-a1b7-b9c6e55ca88c admin admin] Security group rule updated ['c3bddf5a-82c0-4c2c-acbf-b783c9d5563e'] Sep 25 01:08:20.256241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f3510d14-6b74-44d4-a1b7-b9c6e55ca88c admin admin] Resource SecurityGroupRule deleted: f2183100-6a5f-417d-861c-c1f323957f08 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:20.256635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f3510d14-6b74-44d4-a1b7-b9c6e55ca88c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f2183100-6a5f-417d-861c-c1f323957f08), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:20.256928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f3510d14-6b74-44d4-a1b7-b9c6e55ca88c admin admin] Security group rule updated ['c3bddf5a-82c0-4c2c-acbf-b783c9d5563e'] Sep 25 01:08:20.373070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:624 started Sep 25 01:08:20.377163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e257,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=103000000,duration_sec=1263,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:20.378010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:08:20.378603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:624 - starting polling. Elapsed:0.006 Sep 25 01:08:20.380229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:20.384039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e259,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 36}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:20.387333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x7834e25b,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 38}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:20.387765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:624 - port information retrieved. Elapsed:0.015 Sep 25 01:08:20.388200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Starting to process devices in:{'current': {'ac4a2bd7-6ee7-473c-a9f8-42dbedfe85da', 'de4727a2-569d-44c6-a53e-ecc89817f610', '5204c0c3-4410-4695-a405-b599292c4e80', 'fa672580-39eb-4bef-ac5b-6be835c6c88c'}, 'added': set(), 'removed': {'025c4caf-135a-4da4-9e95-24f950bedb8b', '0feb7341-0637-4360-9832-808376ee9e2a'}, 'updated': set(), 're_added': set()} {{(pid=107261) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 25 01:08:20.388720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:624 - agent port security group processed in 0.000 Sep 25 01:08:20.390562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Configuration for devices up [] and devices down [] completed. Sep 25 01:08:20.390946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for {'025c4caf-135a-4da4-9e95-24f950bedb8b', '0feb7341-0637-4360-9832-808376ee9e2a'} Sep 25 01:08:20.391502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 0feb7341-0637-4360-9832-808376ee9e2a is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:08:20.392032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Processing 4 OpenFlow rules. {{(pid=107261) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 25 01:08:20.444942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bd1cd2-43ee-4247-b178-cf3604f4686e]: (4, ('', '', 0)) {{(pid=108960) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 25 01:08:20.445977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Ports {'025c4caf-135a-4da4-9e95-24f950bedb8b', '0feb7341-0637-4360-9832-808376ee9e2a'} removed Sep 25 01:08:20.513434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port removal failed for set() {{(pid=107261) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 25 01:08:20.514613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Reclaiming vlan = 14 from net-id = dbea2e08-a361-48c8-95fc-03b3fc326d51, seg-id = 60 Sep 25 01:08:20.518223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xa5d7ab66,OFPFlowMod(buffer_id=4294967295,command=3,cookie=13979250796582379444,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4110}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:20.521425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0x7834e25d,OFPFlowMod(buffer_id=4294967295,command=3,cookie=5543098084362340806,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4156}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:20.521954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:08:20.522436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] process_network_ports - iteration:624 - treat_devices_removed completed in 0.131 Sep 25 01:08:20.522876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:624 - ports processed. Elapsed:0.150 Sep 25 01:08:20.523402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:624 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.151 Sep 25 01:08:22.374581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:625 started Sep 25 01:08:22.380235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e25f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=105000000,duration_sec=1265,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:22.381091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:08:22.381668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:625 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 25 01:08:24.375046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:626 started Sep 25 01:08:24.378153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e261,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=104000000,duration_sec=1267,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:24.378855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:08:24.379304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:626 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:08:25.730780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7bebdaf5-5875-4f20-9b53-ca8fce922476 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:08:25Z,description='Default security group',id=320e8dd5-bdfe-4778-8685-3f31a7079d13,is_default=True,name='default',project_id='02094d9dfdc245d38c7181f92f9f6b86',revision_number=1,rules=[SecurityGroupRule(7831e2d0-2700-483a-8a0a-69b3f4b53865),SecurityGroupRule(b0395d55-6233-4fa5-ae3d-f869a983760f),SecurityGroupRule(d536f700-ce09-455d-94af-d61e64d14634),SecurityGroupRule(eb1e0566-4bac-4ef8-89e7-a1187f0905c8)],shared=False,stateful=True,updated_at=2022-09-25T01:08:25Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:25.731848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7bebdaf5-5875-4f20-9b53-ca8fce922476 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (320e8dd5-bdfe-4778-8685-3f31a7079d13), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:25.732462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7bebdaf5-5875-4f20-9b53-ca8fce922476 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:08:25Z,description=,direction='egress',ethertype='IPv4',id=7831e2d0-2700-483a-8a0a-69b3f4b53865,normalized_cidr=None,port_range_max=,port_range_min=,project_id='02094d9dfdc245d38c7181f92f9f6b86',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=320e8dd5-bdfe-4778-8685-3f31a7079d13,updated_at=2022-09-25T01:08:25Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:25.733043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7bebdaf5-5875-4f20-9b53-ca8fce922476 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (7831e2d0-2700-483a-8a0a-69b3f4b53865), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:25.733602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-7bebdaf5-5875-4f20-9b53-ca8fce922476 admin admin] Security group rule updated ['320e8dd5-bdfe-4778-8685-3f31a7079d13'] Sep 25 01:08:25.734466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7bebdaf5-5875-4f20-9b53-ca8fce922476 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:08:25Z,description=,direction='ingress',ethertype='IPv6',id=b0395d55-6233-4fa5-ae3d-f869a983760f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='02094d9dfdc245d38c7181f92f9f6b86',protocol=,remote_address_group_id=,remote_group_id=320e8dd5-bdfe-4778-8685-3f31a7079d13,remote_ip_prefix=,revision_number=0,security_group_id=320e8dd5-bdfe-4778-8685-3f31a7079d13,updated_at=2022-09-25T01:08:25Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:25.734974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7bebdaf5-5875-4f20-9b53-ca8fce922476 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (b0395d55-6233-4fa5-ae3d-f869a983760f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:25.735448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-7bebdaf5-5875-4f20-9b53-ca8fce922476 admin admin] Security group rule updated ['320e8dd5-bdfe-4778-8685-3f31a7079d13'] Sep 25 01:08:25.736267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7bebdaf5-5875-4f20-9b53-ca8fce922476 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:08:25Z,description=,direction='ingress',ethertype='IPv4',id=d536f700-ce09-455d-94af-d61e64d14634,normalized_cidr=None,port_range_max=,port_range_min=,project_id='02094d9dfdc245d38c7181f92f9f6b86',protocol=,remote_address_group_id=,remote_group_id=320e8dd5-bdfe-4778-8685-3f31a7079d13,remote_ip_prefix=,revision_number=0,security_group_id=320e8dd5-bdfe-4778-8685-3f31a7079d13,updated_at=2022-09-25T01:08:25Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:25.736792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7bebdaf5-5875-4f20-9b53-ca8fce922476 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (d536f700-ce09-455d-94af-d61e64d14634), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:25.737332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-7bebdaf5-5875-4f20-9b53-ca8fce922476 admin admin] Security group rule updated ['320e8dd5-bdfe-4778-8685-3f31a7079d13'] Sep 25 01:08:25.738449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7bebdaf5-5875-4f20-9b53-ca8fce922476 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:08:25Z,description=,direction='egress',ethertype='IPv6',id=eb1e0566-4bac-4ef8-89e7-a1187f0905c8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='02094d9dfdc245d38c7181f92f9f6b86',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=320e8dd5-bdfe-4778-8685-3f31a7079d13,updated_at=2022-09-25T01:08:25Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:25.739044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7bebdaf5-5875-4f20-9b53-ca8fce922476 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (eb1e0566-4bac-4ef8-89e7-a1187f0905c8), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:25.739540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-7bebdaf5-5875-4f20-9b53-ca8fce922476 admin admin] Security group rule updated ['320e8dd5-bdfe-4778-8685-3f31a7079d13'] Sep 25 01:08:25.894517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2475a093-7c62-457e-a79f-4461a3629ea0 admin admin] Resource SecurityGroup deleted: 320e8dd5-bdfe-4778-8685-3f31a7079d13 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:25.894947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2475a093-7c62-457e-a79f-4461a3629ea0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (320e8dd5-bdfe-4778-8685-3f31a7079d13), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:25.895441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2475a093-7c62-457e-a79f-4461a3629ea0 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('320e8dd5-bdfe-4778-8685-3f31a7079d13',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:08:25.913549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2475a093-7c62-457e-a79f-4461a3629ea0 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('320e8dd5-bdfe-4778-8685-3f31a7079d13',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:08:25.914078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2475a093-7c62-457e-a79f-4461a3629ea0 admin admin] Resource SecurityGroupRule deleted: 7831e2d0-2700-483a-8a0a-69b3f4b53865 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:25.914599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2475a093-7c62-457e-a79f-4461a3629ea0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (7831e2d0-2700-483a-8a0a-69b3f4b53865), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:25.915057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2475a093-7c62-457e-a79f-4461a3629ea0 admin admin] Security group rule updated ['320e8dd5-bdfe-4778-8685-3f31a7079d13'] Sep 25 01:08:25.915665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2475a093-7c62-457e-a79f-4461a3629ea0 admin admin] Resource SecurityGroupRule deleted: b0395d55-6233-4fa5-ae3d-f869a983760f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:25.916187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2475a093-7c62-457e-a79f-4461a3629ea0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (b0395d55-6233-4fa5-ae3d-f869a983760f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:25.916562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2475a093-7c62-457e-a79f-4461a3629ea0 admin admin] Security group rule updated ['320e8dd5-bdfe-4778-8685-3f31a7079d13'] Sep 25 01:08:25.917198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2475a093-7c62-457e-a79f-4461a3629ea0 admin admin] Resource SecurityGroupRule deleted: d536f700-ce09-455d-94af-d61e64d14634 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:25.918295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2475a093-7c62-457e-a79f-4461a3629ea0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (d536f700-ce09-455d-94af-d61e64d14634), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:25.918694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2475a093-7c62-457e-a79f-4461a3629ea0 admin admin] Security group rule updated ['320e8dd5-bdfe-4778-8685-3f31a7079d13'] Sep 25 01:08:25.919162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-2475a093-7c62-457e-a79f-4461a3629ea0 admin admin] Resource SecurityGroupRule deleted: eb1e0566-4bac-4ef8-89e7-a1187f0905c8 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:25.919663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-2475a093-7c62-457e-a79f-4461a3629ea0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (eb1e0566-4bac-4ef8-89e7-a1187f0905c8), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:25.920033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-2475a093-7c62-457e-a79f-4461a3629ea0 admin admin] Security group rule updated ['320e8dd5-bdfe-4778-8685-3f31a7079d13'] Sep 25 01:08:26.374197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a2c99485-c0cc-4661-aceb-5e48845282d9 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:08:26Z,description='Default security group',id=226c5455-85c7-4ef1-b582-2b17467b3f80,is_default=True,name='default',project_id='7e340a45aec4486ca8a50e2f2f7e231e',revision_number=1,rules=[SecurityGroupRule(256d2bb7-dd71-4a6c-b778-198edb841a50),SecurityGroupRule(2fd22200-3662-4100-abda-7a8d181712c4),SecurityGroupRule(caccf0a5-f0e0-433b-9977-037c15e40c08),SecurityGroupRule(f54d637c-f081-4d41-bbf5-bc5d9290e828)],shared=False,stateful=True,updated_at=2022-09-25T01:08:26Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:26.374744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a2c99485-c0cc-4661-aceb-5e48845282d9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (226c5455-85c7-4ef1-b582-2b17467b3f80), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:26.375543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a2c99485-c0cc-4661-aceb-5e48845282d9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:08:26Z,description=,direction='ingress',ethertype='IPv6',id=256d2bb7-dd71-4a6c-b778-198edb841a50,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7e340a45aec4486ca8a50e2f2f7e231e',protocol=,remote_address_group_id=,remote_group_id=226c5455-85c7-4ef1-b582-2b17467b3f80,remote_ip_prefix=,revision_number=0,security_group_id=226c5455-85c7-4ef1-b582-2b17467b3f80,updated_at=2022-09-25T01:08:26Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:26.376078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a2c99485-c0cc-4661-aceb-5e48845282d9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (256d2bb7-dd71-4a6c-b778-198edb841a50), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:26.376704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a2c99485-c0cc-4661-aceb-5e48845282d9 admin admin] Security group rule updated ['226c5455-85c7-4ef1-b582-2b17467b3f80'] Sep 25 01:08:26.377620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a2c99485-c0cc-4661-aceb-5e48845282d9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:08:26Z,description=,direction='ingress',ethertype='IPv4',id=2fd22200-3662-4100-abda-7a8d181712c4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7e340a45aec4486ca8a50e2f2f7e231e',protocol=,remote_address_group_id=,remote_group_id=226c5455-85c7-4ef1-b582-2b17467b3f80,remote_ip_prefix=,revision_number=0,security_group_id=226c5455-85c7-4ef1-b582-2b17467b3f80,updated_at=2022-09-25T01:08:26Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:26.378019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a2c99485-c0cc-4661-aceb-5e48845282d9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (2fd22200-3662-4100-abda-7a8d181712c4), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:26.378409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a2c99485-c0cc-4661-aceb-5e48845282d9 admin admin] Security group rule updated ['226c5455-85c7-4ef1-b582-2b17467b3f80'] Sep 25 01:08:26.379182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a2c99485-c0cc-4661-aceb-5e48845282d9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:08:26Z,description=,direction='egress',ethertype='IPv4',id=caccf0a5-f0e0-433b-9977-037c15e40c08,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7e340a45aec4486ca8a50e2f2f7e231e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=226c5455-85c7-4ef1-b582-2b17467b3f80,updated_at=2022-09-25T01:08:26Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:26.379611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a2c99485-c0cc-4661-aceb-5e48845282d9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (caccf0a5-f0e0-433b-9977-037c15e40c08), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:26.380069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a2c99485-c0cc-4661-aceb-5e48845282d9 admin admin] Security group rule updated ['226c5455-85c7-4ef1-b582-2b17467b3f80'] Sep 25 01:08:26.380893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a2c99485-c0cc-4661-aceb-5e48845282d9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:08:26Z,description=,direction='egress',ethertype='IPv6',id=f54d637c-f081-4d41-bbf5-bc5d9290e828,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7e340a45aec4486ca8a50e2f2f7e231e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=226c5455-85c7-4ef1-b582-2b17467b3f80,updated_at=2022-09-25T01:08:26Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:26.381475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a2c99485-c0cc-4661-aceb-5e48845282d9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f54d637c-f081-4d41-bbf5-bc5d9290e828), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:26.382032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a2c99485-c0cc-4661-aceb-5e48845282d9 admin admin] Security group rule updated ['226c5455-85c7-4ef1-b582-2b17467b3f80'] Sep 25 01:08:26.383228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:627 started Sep 25 01:08:26.385957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e263,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=112000000,duration_sec=1269,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:26.387881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:08:26.388455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:627 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:08:26.550246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d68689fe-87c2-44b4-81e2-98fa3f49de93 admin admin] Resource SecurityGroup deleted: 226c5455-85c7-4ef1-b582-2b17467b3f80 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:26.550838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d68689fe-87c2-44b4-81e2-98fa3f49de93 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (226c5455-85c7-4ef1-b582-2b17467b3f80), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:26.551792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d68689fe-87c2-44b4-81e2-98fa3f49de93 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('226c5455-85c7-4ef1-b582-2b17467b3f80',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:08:26.569630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d68689fe-87c2-44b4-81e2-98fa3f49de93 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('226c5455-85c7-4ef1-b582-2b17467b3f80',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:08:26.571265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d68689fe-87c2-44b4-81e2-98fa3f49de93 admin admin] Resource SecurityGroupRule deleted: 256d2bb7-dd71-4a6c-b778-198edb841a50 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:26.571903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d68689fe-87c2-44b4-81e2-98fa3f49de93 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (256d2bb7-dd71-4a6c-b778-198edb841a50), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:26.572476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d68689fe-87c2-44b4-81e2-98fa3f49de93 admin admin] Security group rule updated ['226c5455-85c7-4ef1-b582-2b17467b3f80'] Sep 25 01:08:26.573159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d68689fe-87c2-44b4-81e2-98fa3f49de93 admin admin] Resource SecurityGroupRule deleted: 2fd22200-3662-4100-abda-7a8d181712c4 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:26.573833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d68689fe-87c2-44b4-81e2-98fa3f49de93 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (2fd22200-3662-4100-abda-7a8d181712c4), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:26.574935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d68689fe-87c2-44b4-81e2-98fa3f49de93 admin admin] Security group rule updated ['226c5455-85c7-4ef1-b582-2b17467b3f80'] Sep 25 01:08:26.575592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d68689fe-87c2-44b4-81e2-98fa3f49de93 admin admin] Resource SecurityGroupRule deleted: caccf0a5-f0e0-433b-9977-037c15e40c08 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:26.576192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d68689fe-87c2-44b4-81e2-98fa3f49de93 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (caccf0a5-f0e0-433b-9977-037c15e40c08), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:26.577487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d68689fe-87c2-44b4-81e2-98fa3f49de93 admin admin] Security group rule updated ['226c5455-85c7-4ef1-b582-2b17467b3f80'] Sep 25 01:08:26.578168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d68689fe-87c2-44b4-81e2-98fa3f49de93 admin admin] Resource SecurityGroupRule deleted: f54d637c-f081-4d41-bbf5-bc5d9290e828 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:26.578735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d68689fe-87c2-44b4-81e2-98fa3f49de93 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f54d637c-f081-4d41-bbf5-bc5d9290e828), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:26.579298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-d68689fe-87c2-44b4-81e2-98fa3f49de93 admin admin] Security group rule updated ['226c5455-85c7-4ef1-b582-2b17467b3f80'] Sep 25 01:08:28.384334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:628 started Sep 25 01:08:28.388822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e265,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=114000000,duration_sec=1271,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:28.389944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:08:28.390391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:628 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:08:30.385315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:629 started Sep 25 01:08:30.388377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e267,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=114000000,duration_sec=1273,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:30.388989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:08:30.389388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:629 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:08:32.386437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:630 started Sep 25 01:08:32.389191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e269,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=115000000,duration_sec=1275,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:32.389871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:08:32.390268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:630 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:08:34.387064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:631 started Sep 25 01:08:34.389755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e26b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=115000000,duration_sec=1277,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:34.390407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:08:34.390803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:631 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:08:36.008571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-14de5c35-d99a-4571-815c-12e2aaf3853a admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:08:35Z,description='Default security group',id=d0ec33a7-1810-40f5-8e68-cb9eed8d8532,is_default=True,name='default',project_id='63a1bee4947648e683d48d513aa1be5d',revision_number=1,rules=[SecurityGroupRule(0edce0c4-405d-4945-a1d5-1e745b867f7b),SecurityGroupRule(7c653950-4fb5-445d-abaa-344e2070f086),SecurityGroupRule(824d02e0-8c92-4437-96b1-d7ad554f164a),SecurityGroupRule(a4811a7a-59d2-4073-bd1a-9968cfe3ab11)],shared=False,stateful=True,updated_at=2022-09-25T01:08:35Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:36.009526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-14de5c35-d99a-4571-815c-12e2aaf3853a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (d0ec33a7-1810-40f5-8e68-cb9eed8d8532), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:36.009702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-14de5c35-d99a-4571-815c-12e2aaf3853a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:08:35Z,description=,direction='ingress',ethertype='IPv6',id=0edce0c4-405d-4945-a1d5-1e745b867f7b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='63a1bee4947648e683d48d513aa1be5d',protocol=,remote_address_group_id=,remote_group_id=d0ec33a7-1810-40f5-8e68-cb9eed8d8532,remote_ip_prefix=,revision_number=0,security_group_id=d0ec33a7-1810-40f5-8e68-cb9eed8d8532,updated_at=2022-09-25T01:08:35Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:36.010008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-14de5c35-d99a-4571-815c-12e2aaf3853a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (0edce0c4-405d-4945-a1d5-1e745b867f7b), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:36.010346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-14de5c35-d99a-4571-815c-12e2aaf3853a admin admin] Security group rule updated ['d0ec33a7-1810-40f5-8e68-cb9eed8d8532'] Sep 25 01:08:36.011123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-14de5c35-d99a-4571-815c-12e2aaf3853a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:08:35Z,description=,direction='ingress',ethertype='IPv4',id=7c653950-4fb5-445d-abaa-344e2070f086,normalized_cidr=None,port_range_max=,port_range_min=,project_id='63a1bee4947648e683d48d513aa1be5d',protocol=,remote_address_group_id=,remote_group_id=d0ec33a7-1810-40f5-8e68-cb9eed8d8532,remote_ip_prefix=,revision_number=0,security_group_id=d0ec33a7-1810-40f5-8e68-cb9eed8d8532,updated_at=2022-09-25T01:08:35Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:36.011692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-14de5c35-d99a-4571-815c-12e2aaf3853a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (7c653950-4fb5-445d-abaa-344e2070f086), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:36.012035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-14de5c35-d99a-4571-815c-12e2aaf3853a admin admin] Security group rule updated ['d0ec33a7-1810-40f5-8e68-cb9eed8d8532'] Sep 25 01:08:36.012743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-14de5c35-d99a-4571-815c-12e2aaf3853a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:08:35Z,description=,direction='egress',ethertype='IPv4',id=824d02e0-8c92-4437-96b1-d7ad554f164a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='63a1bee4947648e683d48d513aa1be5d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d0ec33a7-1810-40f5-8e68-cb9eed8d8532,updated_at=2022-09-25T01:08:35Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:36.013104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-14de5c35-d99a-4571-815c-12e2aaf3853a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (824d02e0-8c92-4437-96b1-d7ad554f164a), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:36.013477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-14de5c35-d99a-4571-815c-12e2aaf3853a admin admin] Security group rule updated ['d0ec33a7-1810-40f5-8e68-cb9eed8d8532'] Sep 25 01:08:36.014169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-14de5c35-d99a-4571-815c-12e2aaf3853a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:08:35Z,description=,direction='egress',ethertype='IPv6',id=a4811a7a-59d2-4073-bd1a-9968cfe3ab11,normalized_cidr=None,port_range_max=,port_range_min=,project_id='63a1bee4947648e683d48d513aa1be5d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d0ec33a7-1810-40f5-8e68-cb9eed8d8532,updated_at=2022-09-25T01:08:35Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:36.014527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-14de5c35-d99a-4571-815c-12e2aaf3853a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (a4811a7a-59d2-4073-bd1a-9968cfe3ab11), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:36.014860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-14de5c35-d99a-4571-815c-12e2aaf3853a admin admin] Security group rule updated ['d0ec33a7-1810-40f5-8e68-cb9eed8d8532'] Sep 25 01:08:36.244138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-988dfd91-f359-46e2-81c4-7a800001cf0c admin admin] Resource SecurityGroup deleted: d0ec33a7-1810-40f5-8e68-cb9eed8d8532 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:36.244663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-988dfd91-f359-46e2-81c4-7a800001cf0c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (d0ec33a7-1810-40f5-8e68-cb9eed8d8532), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:36.245830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-988dfd91-f359-46e2-81c4-7a800001cf0c admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('d0ec33a7-1810-40f5-8e68-cb9eed8d8532',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:08:36.270940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-988dfd91-f359-46e2-81c4-7a800001cf0c admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('d0ec33a7-1810-40f5-8e68-cb9eed8d8532',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:08:36.271727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-988dfd91-f359-46e2-81c4-7a800001cf0c admin admin] Resource SecurityGroupRule deleted: 0edce0c4-405d-4945-a1d5-1e745b867f7b {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:36.272347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-988dfd91-f359-46e2-81c4-7a800001cf0c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (0edce0c4-405d-4945-a1d5-1e745b867f7b), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:36.273037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-988dfd91-f359-46e2-81c4-7a800001cf0c admin admin] Security group rule updated ['d0ec33a7-1810-40f5-8e68-cb9eed8d8532'] Sep 25 01:08:36.273678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-988dfd91-f359-46e2-81c4-7a800001cf0c admin admin] Resource SecurityGroupRule deleted: 7c653950-4fb5-445d-abaa-344e2070f086 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:36.274988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-988dfd91-f359-46e2-81c4-7a800001cf0c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (7c653950-4fb5-445d-abaa-344e2070f086), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:36.275647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-988dfd91-f359-46e2-81c4-7a800001cf0c admin admin] Security group rule updated ['d0ec33a7-1810-40f5-8e68-cb9eed8d8532'] Sep 25 01:08:36.276163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-988dfd91-f359-46e2-81c4-7a800001cf0c admin admin] Resource SecurityGroupRule deleted: 824d02e0-8c92-4437-96b1-d7ad554f164a {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:36.277098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-988dfd91-f359-46e2-81c4-7a800001cf0c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (824d02e0-8c92-4437-96b1-d7ad554f164a), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:36.277585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-988dfd91-f359-46e2-81c4-7a800001cf0c admin admin] Security group rule updated ['d0ec33a7-1810-40f5-8e68-cb9eed8d8532'] Sep 25 01:08:36.278601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-988dfd91-f359-46e2-81c4-7a800001cf0c admin admin] Resource SecurityGroupRule deleted: a4811a7a-59d2-4073-bd1a-9968cfe3ab11 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:36.279261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-988dfd91-f359-46e2-81c4-7a800001cf0c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (a4811a7a-59d2-4073-bd1a-9968cfe3ab11), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:36.280099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-988dfd91-f359-46e2-81c4-7a800001cf0c admin admin] Security group rule updated ['d0ec33a7-1810-40f5-8e68-cb9eed8d8532'] Sep 25 01:08:36.388150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:632 started Sep 25 01:08:36.391295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e26d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=117000000,duration_sec=1279,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:36.392014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:08:36.392477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:632 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:08:36.783461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-36c254c7-53e9-4d90-a891-278c72f1cab5 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:08:36Z,description='Default security group',id=2b58584e-bd88-4706-8443-91847752baf4,is_default=True,name='default',project_id='5a9894e9728943c79f2abff50b183d69',revision_number=1,rules=[SecurityGroupRule(5b6233ce-c9ed-46ed-b116-e20310805e49),SecurityGroupRule(6f38eede-deb5-43cf-97af-1376ab27fe50),SecurityGroupRule(75f874b1-c44d-423a-9385-b8985773c8d5),SecurityGroupRule(84fdcf13-3f20-47ff-b610-f40cf1c0b78e)],shared=False,stateful=True,updated_at=2022-09-25T01:08:36Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:36.784199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-36c254c7-53e9-4d90-a891-278c72f1cab5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (2b58584e-bd88-4706-8443-91847752baf4), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:36.785688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-36c254c7-53e9-4d90-a891-278c72f1cab5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:08:36Z,description=,direction='ingress',ethertype='IPv4',id=5b6233ce-c9ed-46ed-b116-e20310805e49,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5a9894e9728943c79f2abff50b183d69',protocol=,remote_address_group_id=,remote_group_id=2b58584e-bd88-4706-8443-91847752baf4,remote_ip_prefix=,revision_number=0,security_group_id=2b58584e-bd88-4706-8443-91847752baf4,updated_at=2022-09-25T01:08:36Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:36.786517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-36c254c7-53e9-4d90-a891-278c72f1cab5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (5b6233ce-c9ed-46ed-b116-e20310805e49), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:36.786708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-36c254c7-53e9-4d90-a891-278c72f1cab5 admin admin] Security group rule updated ['2b58584e-bd88-4706-8443-91847752baf4'] Sep 25 01:08:36.787436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-36c254c7-53e9-4d90-a891-278c72f1cab5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:08:36Z,description=,direction='egress',ethertype='IPv6',id=6f38eede-deb5-43cf-97af-1376ab27fe50,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5a9894e9728943c79f2abff50b183d69',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2b58584e-bd88-4706-8443-91847752baf4,updated_at=2022-09-25T01:08:36Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:36.787888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-36c254c7-53e9-4d90-a891-278c72f1cab5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (6f38eede-deb5-43cf-97af-1376ab27fe50), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:36.788402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-36c254c7-53e9-4d90-a891-278c72f1cab5 admin admin] Security group rule updated ['2b58584e-bd88-4706-8443-91847752baf4'] Sep 25 01:08:36.789182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-36c254c7-53e9-4d90-a891-278c72f1cab5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:08:36Z,description=,direction='egress',ethertype='IPv4',id=75f874b1-c44d-423a-9385-b8985773c8d5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5a9894e9728943c79f2abff50b183d69',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2b58584e-bd88-4706-8443-91847752baf4,updated_at=2022-09-25T01:08:36Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:36.789679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-36c254c7-53e9-4d90-a891-278c72f1cab5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (75f874b1-c44d-423a-9385-b8985773c8d5), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:36.790118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-36c254c7-53e9-4d90-a891-278c72f1cab5 admin admin] Security group rule updated ['2b58584e-bd88-4706-8443-91847752baf4'] Sep 25 01:08:36.790919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-36c254c7-53e9-4d90-a891-278c72f1cab5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:08:36Z,description=,direction='ingress',ethertype='IPv6',id=84fdcf13-3f20-47ff-b610-f40cf1c0b78e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5a9894e9728943c79f2abff50b183d69',protocol=,remote_address_group_id=,remote_group_id=2b58584e-bd88-4706-8443-91847752baf4,remote_ip_prefix=,revision_number=0,security_group_id=2b58584e-bd88-4706-8443-91847752baf4,updated_at=2022-09-25T01:08:36Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:36.791417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-36c254c7-53e9-4d90-a891-278c72f1cab5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (84fdcf13-3f20-47ff-b610-f40cf1c0b78e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:36.791872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-36c254c7-53e9-4d90-a891-278c72f1cab5 admin admin] Security group rule updated ['2b58584e-bd88-4706-8443-91847752baf4'] Sep 25 01:08:37.321062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c0090351-4546-40a0-90b5-3534250e7ffb admin admin] Resource SecurityGroup deleted: 2b58584e-bd88-4706-8443-91847752baf4 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:37.322274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c0090351-4546-40a0-90b5-3534250e7ffb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (2b58584e-bd88-4706-8443-91847752baf4), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:37.322752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0090351-4546-40a0-90b5-3534250e7ffb admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2b58584e-bd88-4706-8443-91847752baf4',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:08:37.345892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c0090351-4546-40a0-90b5-3534250e7ffb admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2b58584e-bd88-4706-8443-91847752baf4',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:08:37.346615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c0090351-4546-40a0-90b5-3534250e7ffb admin admin] Resource SecurityGroupRule deleted: 5b6233ce-c9ed-46ed-b116-e20310805e49 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:37.347134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c0090351-4546-40a0-90b5-3534250e7ffb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (5b6233ce-c9ed-46ed-b116-e20310805e49), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:37.347665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c0090351-4546-40a0-90b5-3534250e7ffb admin admin] Security group rule updated ['2b58584e-bd88-4706-8443-91847752baf4'] Sep 25 01:08:37.348351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c0090351-4546-40a0-90b5-3534250e7ffb admin admin] Resource SecurityGroupRule deleted: 6f38eede-deb5-43cf-97af-1376ab27fe50 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:37.348914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c0090351-4546-40a0-90b5-3534250e7ffb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (6f38eede-deb5-43cf-97af-1376ab27fe50), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:37.349385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c0090351-4546-40a0-90b5-3534250e7ffb admin admin] Security group rule updated ['2b58584e-bd88-4706-8443-91847752baf4'] Sep 25 01:08:37.352107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c0090351-4546-40a0-90b5-3534250e7ffb admin admin] Resource SecurityGroupRule deleted: 75f874b1-c44d-423a-9385-b8985773c8d5 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:37.353120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c0090351-4546-40a0-90b5-3534250e7ffb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (75f874b1-c44d-423a-9385-b8985773c8d5), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:37.353724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c0090351-4546-40a0-90b5-3534250e7ffb admin admin] Security group rule updated ['2b58584e-bd88-4706-8443-91847752baf4'] Sep 25 01:08:37.354506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-c0090351-4546-40a0-90b5-3534250e7ffb admin admin] Resource SecurityGroupRule deleted: 84fdcf13-3f20-47ff-b610-f40cf1c0b78e {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:37.355402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-c0090351-4546-40a0-90b5-3534250e7ffb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (84fdcf13-3f20-47ff-b610-f40cf1c0b78e), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:37.355402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-c0090351-4546-40a0-90b5-3534250e7ffb admin admin] Security group rule updated ['2b58584e-bd88-4706-8443-91847752baf4'] Sep 25 01:08:38.014150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-cfb5a1bd-7c74-409d-8895-934ee682a113 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:08:37Z,description='Default security group',id=2997fc43-df83-47b2-a9f0-a2190a56d113,is_default=True,name='default',project_id='95b69cfefdb44334be59ce7ef070079f',revision_number=1,rules=[SecurityGroupRule(66689f3d-1ae5-4ba8-81c5-6dd2a377485e),SecurityGroupRule(7193b86e-22e9-4eea-acce-a9a09dcd3837),SecurityGroupRule(908e8c26-1626-47a4-bfd1-776f96df1415),SecurityGroupRule(c6777d70-f2ff-435d-bb94-a65efaaa7357)],shared=False,stateful=True,updated_at=2022-09-25T01:08:37Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:38.014664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-cfb5a1bd-7c74-409d-8895-934ee682a113 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (2997fc43-df83-47b2-a9f0-a2190a56d113), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:38.015730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-cfb5a1bd-7c74-409d-8895-934ee682a113 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:08:37Z,description=,direction='egress',ethertype='IPv4',id=66689f3d-1ae5-4ba8-81c5-6dd2a377485e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='95b69cfefdb44334be59ce7ef070079f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2997fc43-df83-47b2-a9f0-a2190a56d113,updated_at=2022-09-25T01:08:37Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:38.016314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-cfb5a1bd-7c74-409d-8895-934ee682a113 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (66689f3d-1ae5-4ba8-81c5-6dd2a377485e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:38.016892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-cfb5a1bd-7c74-409d-8895-934ee682a113 admin admin] Security group rule updated ['2997fc43-df83-47b2-a9f0-a2190a56d113'] Sep 25 01:08:38.018140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-cfb5a1bd-7c74-409d-8895-934ee682a113 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:08:37Z,description=,direction='egress',ethertype='IPv6',id=7193b86e-22e9-4eea-acce-a9a09dcd3837,normalized_cidr=None,port_range_max=,port_range_min=,project_id='95b69cfefdb44334be59ce7ef070079f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2997fc43-df83-47b2-a9f0-a2190a56d113,updated_at=2022-09-25T01:08:37Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:38.018735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-cfb5a1bd-7c74-409d-8895-934ee682a113 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (7193b86e-22e9-4eea-acce-a9a09dcd3837), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:38.019256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-cfb5a1bd-7c74-409d-8895-934ee682a113 admin admin] Security group rule updated ['2997fc43-df83-47b2-a9f0-a2190a56d113'] Sep 25 01:08:38.020452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-cfb5a1bd-7c74-409d-8895-934ee682a113 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:08:37Z,description=,direction='ingress',ethertype='IPv4',id=908e8c26-1626-47a4-bfd1-776f96df1415,normalized_cidr=None,port_range_max=,port_range_min=,project_id='95b69cfefdb44334be59ce7ef070079f',protocol=,remote_address_group_id=,remote_group_id=2997fc43-df83-47b2-a9f0-a2190a56d113,remote_ip_prefix=,revision_number=0,security_group_id=2997fc43-df83-47b2-a9f0-a2190a56d113,updated_at=2022-09-25T01:08:37Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:38.021026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-cfb5a1bd-7c74-409d-8895-934ee682a113 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (908e8c26-1626-47a4-bfd1-776f96df1415), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:38.021582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-cfb5a1bd-7c74-409d-8895-934ee682a113 admin admin] Security group rule updated ['2997fc43-df83-47b2-a9f0-a2190a56d113'] Sep 25 01:08:38.022763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-cfb5a1bd-7c74-409d-8895-934ee682a113 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:08:37Z,description=,direction='ingress',ethertype='IPv6',id=c6777d70-f2ff-435d-bb94-a65efaaa7357,normalized_cidr=None,port_range_max=,port_range_min=,project_id='95b69cfefdb44334be59ce7ef070079f',protocol=,remote_address_group_id=,remote_group_id=2997fc43-df83-47b2-a9f0-a2190a56d113,remote_ip_prefix=,revision_number=0,security_group_id=2997fc43-df83-47b2-a9f0-a2190a56d113,updated_at=2022-09-25T01:08:37Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:38.023355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-cfb5a1bd-7c74-409d-8895-934ee682a113 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (c6777d70-f2ff-435d-bb94-a65efaaa7357), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:38.023902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-cfb5a1bd-7c74-409d-8895-934ee682a113 admin admin] Security group rule updated ['2997fc43-df83-47b2-a9f0-a2190a56d113'] Sep 25 01:08:38.185326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b6bfdd73-f831-427f-a87b-2704d800debe admin admin] Resource SecurityGroup deleted: 2997fc43-df83-47b2-a9f0-a2190a56d113 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:38.185917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b6bfdd73-f831-427f-a87b-2704d800debe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (2997fc43-df83-47b2-a9f0-a2190a56d113), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:38.186639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6bfdd73-f831-427f-a87b-2704d800debe admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2997fc43-df83-47b2-a9f0-a2190a56d113',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:08:38.210870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b6bfdd73-f831-427f-a87b-2704d800debe admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2997fc43-df83-47b2-a9f0-a2190a56d113',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:08:38.211730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b6bfdd73-f831-427f-a87b-2704d800debe admin admin] Resource SecurityGroupRule deleted: 66689f3d-1ae5-4ba8-81c5-6dd2a377485e {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:38.212312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b6bfdd73-f831-427f-a87b-2704d800debe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (66689f3d-1ae5-4ba8-81c5-6dd2a377485e), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:38.212853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b6bfdd73-f831-427f-a87b-2704d800debe admin admin] Security group rule updated ['2997fc43-df83-47b2-a9f0-a2190a56d113'] Sep 25 01:08:38.213584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b6bfdd73-f831-427f-a87b-2704d800debe admin admin] Resource SecurityGroupRule deleted: 7193b86e-22e9-4eea-acce-a9a09dcd3837 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:38.214339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b6bfdd73-f831-427f-a87b-2704d800debe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (7193b86e-22e9-4eea-acce-a9a09dcd3837), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:38.215528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b6bfdd73-f831-427f-a87b-2704d800debe admin admin] Security group rule updated ['2997fc43-df83-47b2-a9f0-a2190a56d113'] Sep 25 01:08:38.216038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b6bfdd73-f831-427f-a87b-2704d800debe admin admin] Resource SecurityGroupRule deleted: 908e8c26-1626-47a4-bfd1-776f96df1415 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:38.216560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b6bfdd73-f831-427f-a87b-2704d800debe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (908e8c26-1626-47a4-bfd1-776f96df1415), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:38.217230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b6bfdd73-f831-427f-a87b-2704d800debe admin admin] Security group rule updated ['2997fc43-df83-47b2-a9f0-a2190a56d113'] Sep 25 01:08:38.217807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-b6bfdd73-f831-427f-a87b-2704d800debe admin admin] Resource SecurityGroupRule deleted: c6777d70-f2ff-435d-bb94-a65efaaa7357 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:38.218576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-b6bfdd73-f831-427f-a87b-2704d800debe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (c6777d70-f2ff-435d-bb94-a65efaaa7357), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:38.218989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-b6bfdd73-f831-427f-a87b-2704d800debe admin admin] Security group rule updated ['2997fc43-df83-47b2-a9f0-a2190a56d113'] Sep 25 01:08:38.389788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:633 started Sep 25 01:08:38.395387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e26f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=119000000,duration_sec=1281,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:38.395387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:08:38.395387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:633 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:08:39.447367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-21ebb2f1-7f08-4a02-8912-a21e065b301b admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:08:39Z,description='Default security group',id=176927fd-90ca-4c36-97f3-7146fb286ca1,is_default=True,name='default',project_id='da4aa8615ed349f684f1ea9074a4bf6e',revision_number=1,rules=[SecurityGroupRule(0034433b-cf3c-4063-bfd6-aa89673c2c2d),SecurityGroupRule(84cffca1-8bfb-4861-84c1-4d5a2fe085dc),SecurityGroupRule(9e042288-1f6a-40a1-90e3-1a600e1498d8),SecurityGroupRule(f3925af3-8fee-4492-bb89-475d0597cbae)],shared=False,stateful=True,updated_at=2022-09-25T01:08:39Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:39.448439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-21ebb2f1-7f08-4a02-8912-a21e065b301b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (176927fd-90ca-4c36-97f3-7146fb286ca1), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:39.449524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-21ebb2f1-7f08-4a02-8912-a21e065b301b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:08:39Z,description=,direction='ingress',ethertype='IPv4',id=0034433b-cf3c-4063-bfd6-aa89673c2c2d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='da4aa8615ed349f684f1ea9074a4bf6e',protocol=,remote_address_group_id=,remote_group_id=176927fd-90ca-4c36-97f3-7146fb286ca1,remote_ip_prefix=,revision_number=0,security_group_id=176927fd-90ca-4c36-97f3-7146fb286ca1,updated_at=2022-09-25T01:08:39Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:39.450022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-21ebb2f1-7f08-4a02-8912-a21e065b301b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (0034433b-cf3c-4063-bfd6-aa89673c2c2d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:39.450499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-21ebb2f1-7f08-4a02-8912-a21e065b301b admin admin] Security group rule updated ['176927fd-90ca-4c36-97f3-7146fb286ca1'] Sep 25 01:08:39.451471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-21ebb2f1-7f08-4a02-8912-a21e065b301b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:08:39Z,description=,direction='egress',ethertype='IPv4',id=84cffca1-8bfb-4861-84c1-4d5a2fe085dc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='da4aa8615ed349f684f1ea9074a4bf6e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=176927fd-90ca-4c36-97f3-7146fb286ca1,updated_at=2022-09-25T01:08:39Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:39.451941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-21ebb2f1-7f08-4a02-8912-a21e065b301b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (84cffca1-8bfb-4861-84c1-4d5a2fe085dc), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:39.452385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-21ebb2f1-7f08-4a02-8912-a21e065b301b admin admin] Security group rule updated ['176927fd-90ca-4c36-97f3-7146fb286ca1'] Sep 25 01:08:39.453204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-21ebb2f1-7f08-4a02-8912-a21e065b301b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:08:39Z,description=,direction='ingress',ethertype='IPv6',id=9e042288-1f6a-40a1-90e3-1a600e1498d8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='da4aa8615ed349f684f1ea9074a4bf6e',protocol=,remote_address_group_id=,remote_group_id=176927fd-90ca-4c36-97f3-7146fb286ca1,remote_ip_prefix=,revision_number=0,security_group_id=176927fd-90ca-4c36-97f3-7146fb286ca1,updated_at=2022-09-25T01:08:39Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:39.453720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-21ebb2f1-7f08-4a02-8912-a21e065b301b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (9e042288-1f6a-40a1-90e3-1a600e1498d8), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:39.454155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-21ebb2f1-7f08-4a02-8912-a21e065b301b admin admin] Security group rule updated ['176927fd-90ca-4c36-97f3-7146fb286ca1'] Sep 25 01:08:39.455057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-21ebb2f1-7f08-4a02-8912-a21e065b301b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:08:39Z,description=,direction='egress',ethertype='IPv6',id=f3925af3-8fee-4492-bb89-475d0597cbae,normalized_cidr=None,port_range_max=,port_range_min=,project_id='da4aa8615ed349f684f1ea9074a4bf6e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=176927fd-90ca-4c36-97f3-7146fb286ca1,updated_at=2022-09-25T01:08:39Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:39.455589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-21ebb2f1-7f08-4a02-8912-a21e065b301b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f3925af3-8fee-4492-bb89-475d0597cbae), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:39.456030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-21ebb2f1-7f08-4a02-8912-a21e065b301b admin admin] Security group rule updated ['176927fd-90ca-4c36-97f3-7146fb286ca1'] Sep 25 01:08:39.620301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-21ebb2f1-7f08-4a02-8912-a21e065b301b admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-25T01:08:39Z,description='',dns_domain=None,id=bf2b84f7-77ae-4b11-ada8-9925bb081495,mtu=1500,name='tempest-VolumesActionsTest-546115219-network',project_id='da4aa8615ed349f684f1ea9074a4bf6e',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(bf2b84f7-77ae-4b11-ada8-9925bb081495),segments=[NetworkSegment(5a34dc72-f614-4419-b48e-32590b6fb229)],shared=False,status='ACTIVE',updated_at=2022-09-25T01:08:39Z,vlan_transparent=) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:39.621733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-21ebb2f1-7f08-4a02-8912-a21e065b301b admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (bf2b84f7-77ae-4b11-ada8-9925bb081495), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:39.714016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager [None req-21ebb2f1-7f08-4a02-8912-a21e065b301b admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network bf2b84f7-77ae-4b11-ada8-9925bb081495 with segmentation id not found. Sep 25 01:08:39.714016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 25 01:08:39.714016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 25 01:08:39.714016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 25 01:08:39.714016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 25 01:08:39.714016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 25 01:08:39.714016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 25 01:08:39.714016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 25 01:08:39.714016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 25 01:08:39.714016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 25 01:08:39.714016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 25 01:08:39.714016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 25 01:08:39.714016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 25 01:08:39.716626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 25 01:08:39.716626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 25 01:08:39.716626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 25 01:08:39.716626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network bf2b84f7-77ae-4b11-ada8-9925bb081495 with segmentation id not found. Sep 25 01:08:39.716626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Sep 25 01:08:39.929177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-cb58b8f7-ea2c-4d3f-9234-add43fcf27b8 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(3be311b2-5a38-4339-a7dc-54e24b1151fa)],cidr=172.20.0.0/28,created_at=2022-09-25T01:08:39Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=4ded26e6-fc75-4a1f-8f2f-0ca6cd146e26,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-VolumesActionsTest-546115219-subnet',network_id=bf2b84f7-77ae-4b11-ada8-9925bb081495,project_id='da4aa8615ed349f684f1ea9074a4bf6e',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-25T01:08:39Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:39.930225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-cb58b8f7-ea2c-4d3f-9234-add43fcf27b8 admin admin] Publish callbacks [] for Subnet (4ded26e6-fc75-4a1f-8f2f-0ca6cd146e26), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:40.390337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:634 started Sep 25 01:08:40.393555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e271,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=119000000,duration_sec=1283,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:40.394353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:08:40.394880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:634 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:08:42.391554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:635 started Sep 25 01:08:42.395341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e273,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=121000000,duration_sec=1285,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:42.395986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:08:42.396411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:635 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:08:44.392947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:636 started Sep 25 01:08:44.396507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e275,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=122000000,duration_sec=1287,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:44.397338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:08:44.397800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:636 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:08:44.861089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-3aa100f2-6032-4ea8-9ba9-360826c03694 tempest-VolumesActionsTest-1480353271 tempest-VolumesActionsTest-1480353271-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:08:44Z,data_plane_status=None,description='',device_id='47140790-3a76-434f-b15f-20c16caa1ac0',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=b749a5de-4349-46be-814d-267b61200e7f,mac_address=fa:16:3e:23:1a:ba,name='',network_id=bf2b84f7-77ae-4b11-ada8-9925bb081495,numa_affinity_policy=,project_id='da4aa8615ed349f684f1ea9074a4bf6e',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(b749a5de-4349-46be-814d-267b61200e7f),security_group_ids=set([176927fd-90ca-4c36-97f3-7146fb286ca1]),status='DOWN',updated_at=2022-09-25T01:08:44Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:08:44.861674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-3aa100f2-6032-4ea8-9ba9-360826c03694 tempest-VolumesActionsTest-1480353271 tempest-VolumesActionsTest-1480353271-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (b749a5de-4349-46be-814d-267b61200e7f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:44.862247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-3aa100f2-6032-4ea8-9ba9-360826c03694 tempest-VolumesActionsTest-1480353271 tempest-VolumesActionsTest-1480353271-project] Security group member updated {'176927fd-90ca-4c36-97f3-7146fb286ca1'} Sep 25 01:08:45.517009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-51ed65fc-1fd2-4647-b519-970126106942 service neutron] Resource Port b749a5de-4349-46be-814d-267b61200e7f updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=b749a5de-4349-46be-814d-267b61200e7f,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=b749a5de-4349-46be-814d-267b61200e7f,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:08:45.518291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-51ed65fc-1fd2-4647-b519-970126106942 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (b749a5de-4349-46be-814d-267b61200e7f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:45.884040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-51ed65fc-1fd2-4647-b519-970126106942 service neutron] Resource Port b749a5de-4349-46be-814d-267b61200e7f updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=b749a5de-4349-46be-814d-267b61200e7f,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=b749a5de-4349-46be-814d-267b61200e7f,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=b749a5de-4349-46be-814d-267b61200e7f,segment=NetworkSegment(5a34dc72-f614-4419-b48e-32590b6fb229),segment_id=5a34dc72-f614-4419-b48e-32590b6fb229)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:08:45.884649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-51ed65fc-1fd2-4647-b519-970126106942 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (b749a5de-4349-46be-814d-267b61200e7f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:46.394837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:637 started Sep 25 01:08:46.397906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e277,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=122000000,duration_sec=1289,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:46.399192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:08:46.399874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:637 - starting polling. Elapsed:0.006 Sep 25 01:08:46.403375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:46.405290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:637 - port information retrieved. Elapsed:0.012 Sep 25 01:08:46.405807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:637 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 25 01:08:48.394657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:638 started Sep 25 01:08:48.397997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e279,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=123000000,duration_sec=1291,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:48.398857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:08:48.399390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:638 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:08:48.553925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port b749a5de-4349-46be-814d-267b61200e7f updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:08:48.554483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (b749a5de-4349-46be-814d-267b61200e7f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:50.395503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:639 started Sep 25 01:08:50.399076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e27b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=124000000,duration_sec=1293,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:50.399785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:08:50.400225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:639 - starting polling. Elapsed:0.005 Sep 25 01:08:50.401783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:50.404061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:639 - port information retrieved. Elapsed:0.009 Sep 25 01:08:50.404465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:639 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 25 01:08:50.593964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port b749a5de-4349-46be-814d-267b61200e7f updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:08:50.594351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (b749a5de-4349-46be-814d-267b61200e7f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:52.396313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:640 started Sep 25 01:08:52.399814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e27d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=125000000,duration_sec=1295,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:52.400682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:08:52.401234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:640 - starting polling. Elapsed:0.005 Sep 25 01:08:52.403413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:52.405063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:640 - port information retrieved. Elapsed:0.009 Sep 25 01:08:52.405560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:640 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 25 01:08:54.402873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:641 started Sep 25 01:08:54.405388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e27f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=131000000,duration_sec=1297,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:54.405977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:08:54.406344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:641 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 25 01:08:55.589215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-24612d42-30c0-45c1-922c-c95b51864909 tempest-VolumesActionsTest-1480353271 tempest-VolumesActionsTest-1480353271-project] Resource Port deleted: b749a5de-4349-46be-814d-267b61200e7f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:08:55.591020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-24612d42-30c0-45c1-922c-c95b51864909 tempest-VolumesActionsTest-1480353271 tempest-VolumesActionsTest-1480353271-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (b749a5de-4349-46be-814d-267b61200e7f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:55.591020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-24612d42-30c0-45c1-922c-c95b51864909 tempest-VolumesActionsTest-1480353271 tempest-VolumesActionsTest-1480353271-project] Security group member updated {'176927fd-90ca-4c36-97f3-7146fb286ca1'} Sep 25 01:08:56.398375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:642 started Sep 25 01:08:56.404339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e281,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=127000000,duration_sec=1299,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:56.405330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:08:56.405848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:642 - starting polling. Elapsed:0.008 Sep 25 01:08:56.408203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:08:56.409725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port b749a5de-4349-46be-814d-267b61200e7f not present in bridge br-int Sep 25 01:08:56.410274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:08:56.410753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['b749a5de-4349-46be-814d-267b61200e7f'] Sep 25 01:08:56.411294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port b749a5de-4349-46be-814d-267b61200e7f is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:08:56.413859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:642 - port information retrieved. Elapsed:0.016 Sep 25 01:08:56.414343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:642 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Sep 25 01:08:58.400246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:643 started Sep 25 01:08:58.403913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e283,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=129000000,duration_sec=1301,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:08:58.404701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:08:58.405541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:643 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:09:00.326893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-105d8092-acc2-430d-a47b-2c6f27a8f2cd tempest-VolumesActionsTest-1480353271 tempest-VolumesActionsTest-1480353271-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:08:59Z,data_plane_status=None,description='',device_id='1cb9e557-600c-49fa-bcd2-d191a7c494bc',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=0f50e565-aa39-40fb-b6f7-e3feaa6f231f,mac_address=fa:16:3e:20:35:dc,name='',network_id=bf2b84f7-77ae-4b11-ada8-9925bb081495,numa_affinity_policy=,project_id='da4aa8615ed349f684f1ea9074a4bf6e',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(0f50e565-aa39-40fb-b6f7-e3feaa6f231f),security_group_ids=set([176927fd-90ca-4c36-97f3-7146fb286ca1]),status='DOWN',updated_at=2022-09-25T01:08:59Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:09:00.328041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-105d8092-acc2-430d-a47b-2c6f27a8f2cd tempest-VolumesActionsTest-1480353271 tempest-VolumesActionsTest-1480353271-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (0f50e565-aa39-40fb-b6f7-e3feaa6f231f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:00.329878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-105d8092-acc2-430d-a47b-2c6f27a8f2cd tempest-VolumesActionsTest-1480353271 tempest-VolumesActionsTest-1480353271-project] Security group member updated {'176927fd-90ca-4c36-97f3-7146fb286ca1'} Sep 25 01:09:00.401086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:644 started Sep 25 01:09:00.405460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e285,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=131000000,duration_sec=1303,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:09:00.406169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:09:00.406767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:644 - starting polling. Elapsed:0.006 Sep 25 01:09:00.408292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:00.409866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:644 - port information retrieved. Elapsed:0.009 Sep 25 01:09:00.410263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:644 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 25 01:09:01.480652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ff8f5e4a-b3db-49ae-92b3-b0762b3706ea service neutron] Resource Port 0f50e565-aa39-40fb-b6f7-e3feaa6f231f updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=0f50e565-aa39-40fb-b6f7-e3feaa6f231f,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=0f50e565-aa39-40fb-b6f7-e3feaa6f231f,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:09:01.481865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ff8f5e4a-b3db-49ae-92b3-b0762b3706ea service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (0f50e565-aa39-40fb-b6f7-e3feaa6f231f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:01.813676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ff8f5e4a-b3db-49ae-92b3-b0762b3706ea service neutron] Resource Port 0f50e565-aa39-40fb-b6f7-e3feaa6f231f updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=0f50e565-aa39-40fb-b6f7-e3feaa6f231f,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=0f50e565-aa39-40fb-b6f7-e3feaa6f231f,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=0f50e565-aa39-40fb-b6f7-e3feaa6f231f,segment=NetworkSegment(5a34dc72-f614-4419-b48e-32590b6fb229),segment_id=5a34dc72-f614-4419-b48e-32590b6fb229)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:09:01.814153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ff8f5e4a-b3db-49ae-92b3-b0762b3706ea service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (0f50e565-aa39-40fb-b6f7-e3feaa6f231f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:02.402506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:645 started Sep 25 01:09:02.405618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e287,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=131000000,duration_sec=1305,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:09:02.406384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:09:02.406769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:645 - starting polling. Elapsed:0.005 Sep 25 01:09:02.408091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:02.409454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:645 - port information retrieved. Elapsed:0.007 Sep 25 01:09:02.409791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:645 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 25 01:09:04.402988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:646 started Sep 25 01:09:04.406630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e289,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=132000000,duration_sec=1307,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:09:04.408288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:09:04.408832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:646 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:09:04.743146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 0f50e565-aa39-40fb-b6f7-e3feaa6f231f updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:09:04.743831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (0f50e565-aa39-40fb-b6f7-e3feaa6f231f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:06.404115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:647 started Sep 25 01:09:06.407091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e28b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=133000000,duration_sec=1309,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:09:06.407790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:09:06.408189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:647 - starting polling. Elapsed:0.004 Sep 25 01:09:06.409611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:06.411150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:647 - port information retrieved. Elapsed:0.007 Sep 25 01:09:06.411551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:647 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 25 01:09:06.642810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 0f50e565-aa39-40fb-b6f7-e3feaa6f231f updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:09:06.643273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (0f50e565-aa39-40fb-b6f7-e3feaa6f231f), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:08.405361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:648 started Sep 25 01:09:08.408570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e28d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=134000000,duration_sec=1311,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:09:08.409320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:09:08.409671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:648 - starting polling. Elapsed:0.005 Sep 25 01:09:08.410988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:08.412586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:648 - port information retrieved. Elapsed:0.007 Sep 25 01:09:08.412999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:648 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 25 01:09:10.406860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:649 started Sep 25 01:09:10.410347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e28f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=135000000,duration_sec=1313,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:09:10.411178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:09:10.411725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:649 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:09:11.764732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-1020102d-b84a-4656-bb3d-8fbcf384388f tempest-VolumesActionsTest-1480353271 tempest-VolumesActionsTest-1480353271-project] Resource Port deleted: 0f50e565-aa39-40fb-b6f7-e3feaa6f231f {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:09:11.765876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-1020102d-b84a-4656-bb3d-8fbcf384388f tempest-VolumesActionsTest-1480353271 tempest-VolumesActionsTest-1480353271-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (0f50e565-aa39-40fb-b6f7-e3feaa6f231f), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:11.766722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-1020102d-b84a-4656-bb3d-8fbcf384388f tempest-VolumesActionsTest-1480353271 tempest-VolumesActionsTest-1480353271-project] Security group member updated {'176927fd-90ca-4c36-97f3-7146fb286ca1'} Sep 25 01:09:12.407817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:650 started Sep 25 01:09:12.410760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e291,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=137000000,duration_sec=1315,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:09:12.411374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:09:12.411716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:650 - starting polling. Elapsed:0.004 Sep 25 01:09:12.414184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:12.415418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 0f50e565-aa39-40fb-b6f7-e3feaa6f231f not present in bridge br-int Sep 25 01:09:12.415766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:09:12.416055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['0f50e565-aa39-40fb-b6f7-e3feaa6f231f'] Sep 25 01:09:12.416385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 0f50e565-aa39-40fb-b6f7-e3feaa6f231f is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:09:12.419110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:650 - port information retrieved. Elapsed:0.011 Sep 25 01:09:12.419858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:650 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 25 01:09:14.409063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:651 started Sep 25 01:09:14.412020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e293,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=138000000,duration_sec=1317,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:09:14.412670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:09:14.413067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:651 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:09:16.409732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:652 started Sep 25 01:09:16.412355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e295,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=138000000,duration_sec=1319,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:09:16.413044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:09:16.413587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:652 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:09:18.410744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:653 started Sep 25 01:09:18.419727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e297,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=143000000,duration_sec=1321,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:09:18.421135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:09:18.422247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:653 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 25 01:09:20.412205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:654 started Sep 25 01:09:20.414871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e299,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=141000000,duration_sec=1323,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:09:20.415507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:09:20.415904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:654 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:09:22.413426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:655 started Sep 25 01:09:22.418201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e29b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=143000000,duration_sec=1325,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:09:22.419237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:09:22.419685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:655 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:09:24.420062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:656 started Sep 25 01:09:24.424737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e29d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=149000000,duration_sec=1327,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:09:24.425929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:09:24.426838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:656 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 01:09:26.420969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:657 started Sep 25 01:09:26.428526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e29f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=151000000,duration_sec=1329,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:09:26.430614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:09:26.433609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:657 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 25 01:09:28.423070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:658 started Sep 25 01:09:28.426725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2a1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=152000000,duration_sec=1331,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:09:28.427686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:09:28.428353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:658 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:09:30.424646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:659 started Sep 25 01:09:30.428350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2a3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=153000000,duration_sec=1333,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:09:30.429177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:09:30.429849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:659 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:09:32.425423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:660 started Sep 25 01:09:32.431472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2a5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=156000000,duration_sec=1335,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:09:32.433860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:09:32.435053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:660 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 25 01:09:34.426749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:661 started Sep 25 01:09:34.430690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2a7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=155000000,duration_sec=1337,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:09:34.432073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:09:34.432686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:661 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:09:36.428420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:662 started Sep 25 01:09:36.433659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2a9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=158000000,duration_sec=1339,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:09:36.434667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:09:36.435277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:662 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 01:09:37.787288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-e80c504c-ba99-4056-8ab4-5be47c8c64f7 admin admin] Resource Subnet deleted: 4ded26e6-fc75-4a1f-8f2f-0ca6cd146e26 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:09:37.788399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-e80c504c-ba99-4056-8ab4-5be47c8c64f7 admin admin] Publish callbacks [] for Subnet (4ded26e6-fc75-4a1f-8f2f-0ca6cd146e26), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:38.224075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a64e16ea-bd82-40e9-9dcf-e6682de029f2 admin admin] Resource Network deleted: bf2b84f7-77ae-4b11-ada8-9925bb081495 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:09:38.224889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a64e16ea-bd82-40e9-9dcf-e6682de029f2 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (bf2b84f7-77ae-4b11-ada8-9925bb081495), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:38.430035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:663 started Sep 25 01:09:38.435660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2ab,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=160000000,duration_sec=1341,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:09:38.436670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:09:38.437337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:663 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 01:09:38.543583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0f5fb232-472d-41a1-927b-cf0b27fa4dbf admin admin] Resource SecurityGroup deleted: 176927fd-90ca-4c36-97f3-7146fb286ca1 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:09:38.544165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0f5fb232-472d-41a1-927b-cf0b27fa4dbf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (176927fd-90ca-4c36-97f3-7146fb286ca1), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:38.544873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f5fb232-472d-41a1-927b-cf0b27fa4dbf admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('176927fd-90ca-4c36-97f3-7146fb286ca1',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:09:38.563947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0f5fb232-472d-41a1-927b-cf0b27fa4dbf admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('176927fd-90ca-4c36-97f3-7146fb286ca1',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:09:38.564623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0f5fb232-472d-41a1-927b-cf0b27fa4dbf admin admin] Resource SecurityGroupRule deleted: 0034433b-cf3c-4063-bfd6-aa89673c2c2d {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:09:38.565224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0f5fb232-472d-41a1-927b-cf0b27fa4dbf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (0034433b-cf3c-4063-bfd6-aa89673c2c2d), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:38.566015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-0f5fb232-472d-41a1-927b-cf0b27fa4dbf admin admin] Security group rule updated ['176927fd-90ca-4c36-97f3-7146fb286ca1'] Sep 25 01:09:38.566538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0f5fb232-472d-41a1-927b-cf0b27fa4dbf admin admin] Resource SecurityGroupRule deleted: 84cffca1-8bfb-4861-84c1-4d5a2fe085dc {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:09:38.567088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0f5fb232-472d-41a1-927b-cf0b27fa4dbf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (84cffca1-8bfb-4861-84c1-4d5a2fe085dc), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:38.567840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-0f5fb232-472d-41a1-927b-cf0b27fa4dbf admin admin] Security group rule updated ['176927fd-90ca-4c36-97f3-7146fb286ca1'] Sep 25 01:09:38.568328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0f5fb232-472d-41a1-927b-cf0b27fa4dbf admin admin] Resource SecurityGroupRule deleted: 9e042288-1f6a-40a1-90e3-1a600e1498d8 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:09:38.568820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0f5fb232-472d-41a1-927b-cf0b27fa4dbf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (9e042288-1f6a-40a1-90e3-1a600e1498d8), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:38.569485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-0f5fb232-472d-41a1-927b-cf0b27fa4dbf admin admin] Security group rule updated ['176927fd-90ca-4c36-97f3-7146fb286ca1'] Sep 25 01:09:38.570018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-0f5fb232-472d-41a1-927b-cf0b27fa4dbf admin admin] Resource SecurityGroupRule deleted: f3925af3-8fee-4492-bb89-475d0597cbae {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:09:38.570466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-0f5fb232-472d-41a1-927b-cf0b27fa4dbf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f3925af3-8fee-4492-bb89-475d0597cbae), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:38.570890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-0f5fb232-472d-41a1-927b-cf0b27fa4dbf admin admin] Security group rule updated ['176927fd-90ca-4c36-97f3-7146fb286ca1'] Sep 25 01:09:40.430838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:664 started Sep 25 01:09:40.434248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2ad,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=159000000,duration_sec=1343,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:09:40.434971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:09:40.435442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:664 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:09:42.432281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:665 started Sep 25 01:09:42.435906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2af,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=162000000,duration_sec=1345,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:09:42.436533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:09:42.436943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:665 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:09:43.758899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-583c3984-d509-4aea-8613-a3031ee69f17 tempest-VolumesNegativeTest-2086733823 tempest-VolumesNegativeTest-2086733823-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:09:43Z,description='Default security group',id=a96feec3-9ae6-4a84-bde7-9f49b62ace4d,is_default=True,name='default',project_id='46f8efea67784ad48d92d7ab27e04e5e',revision_number=1,rules=[SecurityGroupRule(10e56794-ac63-4567-9b12-563c321d4f4e),SecurityGroupRule(c0997324-78f1-4f31-8df3-13e0117f3b91),SecurityGroupRule(d52ea1b7-29e2-4207-a17b-197eb0fbb2b6),SecurityGroupRule(f4c8b764-4bff-4365-982b-66387272e35d)],shared=False,stateful=True,updated_at=2022-09-25T01:09:43Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:09:43.760069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-583c3984-d509-4aea-8613-a3031ee69f17 tempest-VolumesNegativeTest-2086733823 tempest-VolumesNegativeTest-2086733823-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (a96feec3-9ae6-4a84-bde7-9f49b62ace4d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:43.761047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-583c3984-d509-4aea-8613-a3031ee69f17 tempest-VolumesNegativeTest-2086733823 tempest-VolumesNegativeTest-2086733823-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:09:43Z,description=,direction='egress',ethertype='IPv6',id=10e56794-ac63-4567-9b12-563c321d4f4e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='46f8efea67784ad48d92d7ab27e04e5e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a96feec3-9ae6-4a84-bde7-9f49b62ace4d,updated_at=2022-09-25T01:09:43Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:09:43.761624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-583c3984-d509-4aea-8613-a3031ee69f17 tempest-VolumesNegativeTest-2086733823 tempest-VolumesNegativeTest-2086733823-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (10e56794-ac63-4567-9b12-563c321d4f4e), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:43.762151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-583c3984-d509-4aea-8613-a3031ee69f17 tempest-VolumesNegativeTest-2086733823 tempest-VolumesNegativeTest-2086733823-project] Security group rule updated ['a96feec3-9ae6-4a84-bde7-9f49b62ace4d'] Sep 25 01:09:43.763300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-583c3984-d509-4aea-8613-a3031ee69f17 tempest-VolumesNegativeTest-2086733823 tempest-VolumesNegativeTest-2086733823-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:09:43Z,description=,direction='ingress',ethertype='IPv4',id=c0997324-78f1-4f31-8df3-13e0117f3b91,normalized_cidr=None,port_range_max=,port_range_min=,project_id='46f8efea67784ad48d92d7ab27e04e5e',protocol=,remote_address_group_id=,remote_group_id=a96feec3-9ae6-4a84-bde7-9f49b62ace4d,remote_ip_prefix=,revision_number=0,security_group_id=a96feec3-9ae6-4a84-bde7-9f49b62ace4d,updated_at=2022-09-25T01:09:43Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:09:43.763845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-583c3984-d509-4aea-8613-a3031ee69f17 tempest-VolumesNegativeTest-2086733823 tempest-VolumesNegativeTest-2086733823-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (c0997324-78f1-4f31-8df3-13e0117f3b91), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:43.764291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-583c3984-d509-4aea-8613-a3031ee69f17 tempest-VolumesNegativeTest-2086733823 tempest-VolumesNegativeTest-2086733823-project] Security group rule updated ['a96feec3-9ae6-4a84-bde7-9f49b62ace4d'] Sep 25 01:09:43.765477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-583c3984-d509-4aea-8613-a3031ee69f17 tempest-VolumesNegativeTest-2086733823 tempest-VolumesNegativeTest-2086733823-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:09:43Z,description=,direction='egress',ethertype='IPv4',id=d52ea1b7-29e2-4207-a17b-197eb0fbb2b6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='46f8efea67784ad48d92d7ab27e04e5e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a96feec3-9ae6-4a84-bde7-9f49b62ace4d,updated_at=2022-09-25T01:09:43Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:09:43.766013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-583c3984-d509-4aea-8613-a3031ee69f17 tempest-VolumesNegativeTest-2086733823 tempest-VolumesNegativeTest-2086733823-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (d52ea1b7-29e2-4207-a17b-197eb0fbb2b6), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:43.766801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-583c3984-d509-4aea-8613-a3031ee69f17 tempest-VolumesNegativeTest-2086733823 tempest-VolumesNegativeTest-2086733823-project] Security group rule updated ['a96feec3-9ae6-4a84-bde7-9f49b62ace4d'] Sep 25 01:09:43.768248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-583c3984-d509-4aea-8613-a3031ee69f17 tempest-VolumesNegativeTest-2086733823 tempest-VolumesNegativeTest-2086733823-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:09:43Z,description=,direction='ingress',ethertype='IPv6',id=f4c8b764-4bff-4365-982b-66387272e35d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='46f8efea67784ad48d92d7ab27e04e5e',protocol=,remote_address_group_id=,remote_group_id=a96feec3-9ae6-4a84-bde7-9f49b62ace4d,remote_ip_prefix=,revision_number=0,security_group_id=a96feec3-9ae6-4a84-bde7-9f49b62ace4d,updated_at=2022-09-25T01:09:43Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:09:43.768794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-583c3984-d509-4aea-8613-a3031ee69f17 tempest-VolumesNegativeTest-2086733823 tempest-VolumesNegativeTest-2086733823-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f4c8b764-4bff-4365-982b-66387272e35d), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:43.769316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-583c3984-d509-4aea-8613-a3031ee69f17 tempest-VolumesNegativeTest-2086733823 tempest-VolumesNegativeTest-2086733823-project] Security group rule updated ['a96feec3-9ae6-4a84-bde7-9f49b62ace4d'] Sep 25 01:09:44.295934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-583c3984-d509-4aea-8613-a3031ee69f17 tempest-VolumesNegativeTest-2086733823 tempest-VolumesNegativeTest-2086733823-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:09:43Z,data_plane_status=None,description='',device_id='1c0fe499-c590-48ca-b769-344dbabce44e',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=58b26c08-ffe5-4779-8d5c-4db5e137c572,mac_address=fa:16:3e:88:1e:a3,name='',network_id=0a266287-67c4-4fb0-b8ee-993368d9faa7,numa_affinity_policy=,project_id='46f8efea67784ad48d92d7ab27e04e5e',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(58b26c08-ffe5-4779-8d5c-4db5e137c572),security_group_ids=set([a96feec3-9ae6-4a84-bde7-9f49b62ace4d]),status='DOWN',updated_at=2022-09-25T01:09:43Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:09:44.296536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-583c3984-d509-4aea-8613-a3031ee69f17 tempest-VolumesNegativeTest-2086733823 tempest-VolumesNegativeTest-2086733823-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (58b26c08-ffe5-4779-8d5c-4db5e137c572), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:44.299423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-583c3984-d509-4aea-8613-a3031ee69f17 tempest-VolumesNegativeTest-2086733823 tempest-VolumesNegativeTest-2086733823-project] Security group member updated {'a96feec3-9ae6-4a84-bde7-9f49b62ace4d'} Sep 25 01:09:44.433346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:666 started Sep 25 01:09:44.438240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2b1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=162000000,duration_sec=1347,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:09:44.439077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:09:44.439551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:666 - starting polling. Elapsed:0.006 Sep 25 01:09:44.441354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:44.443234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:666 - port information retrieved. Elapsed:0.010 Sep 25 01:09:44.443734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:666 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 25 01:09:44.895152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-47b920fc-2064-4ec0-9b8a-6bfa19d05859 service neutron] Resource Port 58b26c08-ffe5-4779-8d5c-4db5e137c572 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=58b26c08-ffe5-4779-8d5c-4db5e137c572,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=58b26c08-ffe5-4779-8d5c-4db5e137c572,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:09:44.896564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-47b920fc-2064-4ec0-9b8a-6bfa19d05859 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (58b26c08-ffe5-4779-8d5c-4db5e137c572), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:45.271341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-47b920fc-2064-4ec0-9b8a-6bfa19d05859 service neutron] Resource Port 58b26c08-ffe5-4779-8d5c-4db5e137c572 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=58b26c08-ffe5-4779-8d5c-4db5e137c572,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=58b26c08-ffe5-4779-8d5c-4db5e137c572,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=58b26c08-ffe5-4779-8d5c-4db5e137c572,segment=NetworkSegment(31da2104-1e9b-4471-a650-0e5a617146c2),segment_id=31da2104-1e9b-4471-a650-0e5a617146c2)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:09:45.271734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-47b920fc-2064-4ec0-9b8a-6bfa19d05859 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (58b26c08-ffe5-4779-8d5c-4db5e137c572), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:46.433875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:667 started Sep 25 01:09:46.437446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2b3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=162000000,duration_sec=1349,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:09:46.438332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:09:46.438874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:667 - starting polling. Elapsed:0.005 Sep 25 01:09:46.441184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:46.443043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:667 - port information retrieved. Elapsed:0.009 Sep 25 01:09:46.443575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:667 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 25 01:09:48.434955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:668 started Sep 25 01:09:48.437872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2b5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=164000000,duration_sec=1351,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:09:48.439352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:09:48.439879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:668 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:09:49.365714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 58b26c08-ffe5-4779-8d5c-4db5e137c572 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:09:49.366312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (58b26c08-ffe5-4779-8d5c-4db5e137c572), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:50.436199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:669 started Sep 25 01:09:50.439172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2b7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=165000000,duration_sec=1353,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:09:50.439773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:09:50.440119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:669 - starting polling. Elapsed:0.004 Sep 25 01:09:50.441425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:50.442753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:669 - port information retrieved. Elapsed:0.007 Sep 25 01:09:50.443088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:669 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 01:09:51.354612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port 58b26c08-ffe5-4779-8d5c-4db5e137c572 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:09:51.354979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (58b26c08-ffe5-4779-8d5c-4db5e137c572), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:52.437525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:670 started Sep 25 01:09:52.440512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2b9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=166000000,duration_sec=1355,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:09:52.441112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:09:52.441487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:670 - starting polling. Elapsed:0.004 Sep 25 01:09:52.442748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:52.444069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:670 - port information retrieved. Elapsed:0.007 Sep 25 01:09:52.444405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:670 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 01:09:54.438484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:671 started Sep 25 01:09:54.441545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2bb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=167000000,duration_sec=1357,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:09:54.442167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:09:54.442533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:671 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:09:56.069359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-051ad573-7fa6-4618-a0af-4876a1bf1a5b tempest-VolumesNegativeTest-2086733823 tempest-VolumesNegativeTest-2086733823-project] Resource Port deleted: 58b26c08-ffe5-4779-8d5c-4db5e137c572 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:09:56.070465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-051ad573-7fa6-4618-a0af-4876a1bf1a5b tempest-VolumesNegativeTest-2086733823 tempest-VolumesNegativeTest-2086733823-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (58b26c08-ffe5-4779-8d5c-4db5e137c572), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:56.070943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-051ad573-7fa6-4618-a0af-4876a1bf1a5b tempest-VolumesNegativeTest-2086733823 tempest-VolumesNegativeTest-2086733823-project] Security group member updated {'a96feec3-9ae6-4a84-bde7-9f49b62ace4d'} Sep 25 01:09:56.439007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:672 started Sep 25 01:09:56.442220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2bd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=168000000,duration_sec=1359,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:09:56.443136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:09:56.443473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:672 - starting polling. Elapsed:0.005 Sep 25 01:09:56.444856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:09:56.445743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 58b26c08-ffe5-4779-8d5c-4db5e137c572 not present in bridge br-int Sep 25 01:09:56.446137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:09:56.446435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['58b26c08-ffe5-4779-8d5c-4db5e137c572'] Sep 25 01:09:56.446792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port 58b26c08-ffe5-4779-8d5c-4db5e137c572 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:09:56.448252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:672 - port information retrieved. Elapsed:0.009 Sep 25 01:09:56.448594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:672 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 25 01:09:58.440014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:673 started Sep 25 01:09:58.443214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2bf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=168000000,duration_sec=1361,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:09:58.443993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:09:58.444444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:673 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:10:00.440952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:674 started Sep 25 01:10:00.443843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2c1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=169000000,duration_sec=1363,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:10:00.444437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:10:00.444844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:674 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:10:02.441905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:675 started Sep 25 01:10:02.444524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2c3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=170000000,duration_sec=1365,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:10:02.445106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:10:02.445488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:675 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:10:02.487545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ff14690d-34f4-4224-b458-05384314f3bf admin admin] Resource SecurityGroup deleted: a96feec3-9ae6-4a84-bde7-9f49b62ace4d {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:10:02.488156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ff14690d-34f4-4224-b458-05384314f3bf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (a96feec3-9ae6-4a84-bde7-9f49b62ace4d), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:10:02.488778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff14690d-34f4-4224-b458-05384314f3bf admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('a96feec3-9ae6-4a84-bde7-9f49b62ace4d',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:10:02.506191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ff14690d-34f4-4224-b458-05384314f3bf admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('a96feec3-9ae6-4a84-bde7-9f49b62ace4d',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:10:02.506665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ff14690d-34f4-4224-b458-05384314f3bf admin admin] Resource SecurityGroupRule deleted: 10e56794-ac63-4567-9b12-563c321d4f4e {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:10:02.507676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ff14690d-34f4-4224-b458-05384314f3bf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (10e56794-ac63-4567-9b12-563c321d4f4e), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:10:02.508093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ff14690d-34f4-4224-b458-05384314f3bf admin admin] Security group rule updated ['a96feec3-9ae6-4a84-bde7-9f49b62ace4d'] Sep 25 01:10:02.508889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ff14690d-34f4-4224-b458-05384314f3bf admin admin] Resource SecurityGroupRule deleted: c0997324-78f1-4f31-8df3-13e0117f3b91 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:10:02.509927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ff14690d-34f4-4224-b458-05384314f3bf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (c0997324-78f1-4f31-8df3-13e0117f3b91), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:10:02.510319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ff14690d-34f4-4224-b458-05384314f3bf admin admin] Security group rule updated ['a96feec3-9ae6-4a84-bde7-9f49b62ace4d'] Sep 25 01:10:02.510785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ff14690d-34f4-4224-b458-05384314f3bf admin admin] Resource SecurityGroupRule deleted: d52ea1b7-29e2-4207-a17b-197eb0fbb2b6 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:10:02.511152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ff14690d-34f4-4224-b458-05384314f3bf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (d52ea1b7-29e2-4207-a17b-197eb0fbb2b6), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:10:02.511516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ff14690d-34f4-4224-b458-05384314f3bf admin admin] Security group rule updated ['a96feec3-9ae6-4a84-bde7-9f49b62ace4d'] Sep 25 01:10:02.511931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-ff14690d-34f4-4224-b458-05384314f3bf admin admin] Resource SecurityGroupRule deleted: f4c8b764-4bff-4365-982b-66387272e35d {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:10:02.512325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-ff14690d-34f4-4224-b458-05384314f3bf admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f4c8b764-4bff-4365-982b-66387272e35d), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:10:02.512830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-ff14690d-34f4-4224-b458-05384314f3bf admin admin] Security group rule updated ['a96feec3-9ae6-4a84-bde7-9f49b62ace4d'] Sep 25 01:10:03.512244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6c78e0e3-ec07-40a3-916f-269339eed20e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-25T01:10:03Z,description='Default security group',id=e519085e-1074-4894-bf01-6cabde2ba0f6,is_default=True,name='default',project_id='1f0ea61e4de94ce083c572843a3f09fa',revision_number=1,rules=[SecurityGroupRule(1ef84868-37b3-4916-b17c-b8facfc1e639),SecurityGroupRule(f7ad153a-d6eb-4f12-be99-a745e787b4dc),SecurityGroupRule(f9476ea5-c69f-4b95-a35e-12c822ba443b),SecurityGroupRule(fc458691-9a76-4498-b17d-23d1d07bc8a1)],shared=False,stateful=True,updated_at=2022-09-25T01:10:03Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:10:03.513452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6c78e0e3-ec07-40a3-916f-269339eed20e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-347805'] for SecurityGroup (e519085e-1074-4894-bf01-6cabde2ba0f6), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:10:03.513998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6c78e0e3-ec07-40a3-916f-269339eed20e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:10:03Z,description=,direction='egress',ethertype='IPv4',id=1ef84868-37b3-4916-b17c-b8facfc1e639,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1f0ea61e4de94ce083c572843a3f09fa',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e519085e-1074-4894-bf01-6cabde2ba0f6,updated_at=2022-09-25T01:10:03Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:10:03.514541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6c78e0e3-ec07-40a3-916f-269339eed20e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (1ef84868-37b3-4916-b17c-b8facfc1e639), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:10:03.515085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-6c78e0e3-ec07-40a3-916f-269339eed20e admin admin] Security group rule updated ['e519085e-1074-4894-bf01-6cabde2ba0f6'] Sep 25 01:10:03.515935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6c78e0e3-ec07-40a3-916f-269339eed20e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:10:03Z,description=,direction='ingress',ethertype='IPv6',id=f7ad153a-d6eb-4f12-be99-a745e787b4dc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1f0ea61e4de94ce083c572843a3f09fa',protocol=,remote_address_group_id=,remote_group_id=e519085e-1074-4894-bf01-6cabde2ba0f6,remote_ip_prefix=,revision_number=0,security_group_id=e519085e-1074-4894-bf01-6cabde2ba0f6,updated_at=2022-09-25T01:10:03Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:10:03.516399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6c78e0e3-ec07-40a3-916f-269339eed20e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f7ad153a-d6eb-4f12-be99-a745e787b4dc), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:10:03.516830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-6c78e0e3-ec07-40a3-916f-269339eed20e admin admin] Security group rule updated ['e519085e-1074-4894-bf01-6cabde2ba0f6'] Sep 25 01:10:03.517652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6c78e0e3-ec07-40a3-916f-269339eed20e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:10:03Z,description=,direction='ingress',ethertype='IPv4',id=f9476ea5-c69f-4b95-a35e-12c822ba443b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1f0ea61e4de94ce083c572843a3f09fa',protocol=,remote_address_group_id=,remote_group_id=e519085e-1074-4894-bf01-6cabde2ba0f6,remote_ip_prefix=,revision_number=0,security_group_id=e519085e-1074-4894-bf01-6cabde2ba0f6,updated_at=2022-09-25T01:10:03Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:10:03.518178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6c78e0e3-ec07-40a3-916f-269339eed20e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (f9476ea5-c69f-4b95-a35e-12c822ba443b), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:10:03.518631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-6c78e0e3-ec07-40a3-916f-269339eed20e admin admin] Security group rule updated ['e519085e-1074-4894-bf01-6cabde2ba0f6'] Sep 25 01:10:03.519407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6c78e0e3-ec07-40a3-916f-269339eed20e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-25T01:10:03Z,description=,direction='egress',ethertype='IPv6',id=fc458691-9a76-4498-b17d-23d1d07bc8a1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1f0ea61e4de94ce083c572843a3f09fa',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=e519085e-1074-4894-bf01-6cabde2ba0f6,updated_at=2022-09-25T01:10:03Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:10:03.519882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6c78e0e3-ec07-40a3-916f-269339eed20e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-347834'] for SecurityGroupRule (fc458691-9a76-4498-b17d-23d1d07bc8a1), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:10:03.520432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-6c78e0e3-ec07-40a3-916f-269339eed20e admin admin] Security group rule updated ['e519085e-1074-4894-bf01-6cabde2ba0f6'] Sep 25 01:10:03.662958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6c78e0e3-ec07-40a3-916f-269339eed20e admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-25T01:10:03Z,description='',dns_domain=None,id=567e0576-161f-495c-b882-012356a1e499,mtu=1500,name='tempest-VolumesSnapshotTestJSON-1523381876-network',project_id='1f0ea61e4de94ce083c572843a3f09fa',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(567e0576-161f-495c-b882-012356a1e499),segments=[NetworkSegment(91deb3d4-b4f9-46ee-bfd1-a81a7d7214d3)],shared=False,status='ACTIVE',updated_at=2022-09-25T01:10:03Z,vlan_transparent=) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:10:03.663948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6c78e0e3-ec07-40a3-916f-269339eed20e admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (567e0576-161f-495c-b882-012356a1e499), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:10:03.758630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager [None req-6c78e0e3-ec07-40a3-916f-269339eed20e admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 567e0576-161f-495c-b882-012356a1e499 with segmentation id not found. Sep 25 01:10:03.758630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 25 01:10:03.758630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 25 01:10:03.758630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 25 01:10:03.758630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 25 01:10:03.758630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 25 01:10:03.758630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 25 01:10:03.758630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 25 01:10:03.758630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 25 01:10:03.758630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 25 01:10:03.758630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 25 01:10:03.758630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 25 01:10:03.758630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 25 01:10:03.760399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 25 01:10:03.760399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 25 01:10:03.760399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 25 01:10:03.760399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 567e0576-161f-495c-b882-012356a1e499 with segmentation id not found. Sep 25 01:10:03.760399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: ERROR neutron_lib.callbacks.manager Sep 25 01:10:03.924570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-6c910741-d47e-44d5-bc68-a43c67bbbb24 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(cf935b08-68f3-4348-b967-578ac019782f)],cidr=172.20.0.0/28,created_at=2022-09-25T01:10:03Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=f578e2f2-1d5a-4625-afad-a99b92b56cab,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-VolumesSnapshotTestJSON-1523381876-subnet',network_id=567e0576-161f-495c-b882-012356a1e499,project_id='1f0ea61e4de94ce083c572843a3f09fa',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-25T01:10:03Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:10:03.925026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-6c910741-d47e-44d5-bc68-a43c67bbbb24 admin admin] Publish callbacks [] for Subnet (f578e2f2-1d5a-4625-afad-a99b92b56cab), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:10:04.442614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:676 started Sep 25 01:10:04.446319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2c5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=171000000,duration_sec=1367,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:10:04.447202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:10:04.447539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:676 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:10:06.444196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:677 started Sep 25 01:10:06.447641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2c7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=173000000,duration_sec=1369,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:10:06.448642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:10:06.449312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:677 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:10:08.444963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:678 started Sep 25 01:10:08.448702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2c9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=174000000,duration_sec=1371,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:10:08.449431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:10:08.449939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:678 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:10:08.748468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-911ef1ca-f4f8-4a40-944d-2c9b1ad13a2a tempest-VolumesSnapshotTestJSON-1338018223 tempest-VolumesSnapshotTestJSON-1338018223-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:10:08Z,data_plane_status=None,description='',device_id='02806a84-8467-4b1c-9e5d-9044627225c8',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=b6d5a291-fe8f-4e93-8b5f-7dfa9448f2b4,mac_address=fa:16:3e:26:07:a7,name='',network_id=567e0576-161f-495c-b882-012356a1e499,numa_affinity_policy=,project_id='1f0ea61e4de94ce083c572843a3f09fa',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(b6d5a291-fe8f-4e93-8b5f-7dfa9448f2b4),security_group_ids=set([e519085e-1074-4894-bf01-6cabde2ba0f6]),status='DOWN',updated_at=2022-09-25T01:10:08Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:10:08.748993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-911ef1ca-f4f8-4a40-944d-2c9b1ad13a2a tempest-VolumesSnapshotTestJSON-1338018223 tempest-VolumesSnapshotTestJSON-1338018223-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (b6d5a291-fe8f-4e93-8b5f-7dfa9448f2b4), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:10:08.749935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-911ef1ca-f4f8-4a40-944d-2c9b1ad13a2a tempest-VolumesSnapshotTestJSON-1338018223 tempest-VolumesSnapshotTestJSON-1338018223-project] Security group member updated {'e519085e-1074-4894-bf01-6cabde2ba0f6'} Sep 25 01:10:09.441976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9e8cbe47-6083-4810-a768-6679459165a2 service neutron] Resource Port b6d5a291-fe8f-4e93-8b5f-7dfa9448f2b4 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=b6d5a291-fe8f-4e93-8b5f-7dfa9448f2b4,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=b6d5a291-fe8f-4e93-8b5f-7dfa9448f2b4,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:10:09.442567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9e8cbe47-6083-4810-a768-6679459165a2 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (b6d5a291-fe8f-4e93-8b5f-7dfa9448f2b4), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:10:09.761470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-9e8cbe47-6083-4810-a768-6679459165a2 service neutron] Resource Port b6d5a291-fe8f-4e93-8b5f-7dfa9448f2b4 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=b6d5a291-fe8f-4e93-8b5f-7dfa9448f2b4,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=b6d5a291-fe8f-4e93-8b5f-7dfa9448f2b4,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=b6d5a291-fe8f-4e93-8b5f-7dfa9448f2b4,segment=NetworkSegment(91deb3d4-b4f9-46ee-bfd1-a81a7d7214d3),segment_id=91deb3d4-b4f9-46ee-bfd1-a81a7d7214d3)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:10:09.762220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-9e8cbe47-6083-4810-a768-6679459165a2 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (b6d5a291-fe8f-4e93-8b5f-7dfa9448f2b4), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:10:10.446154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:679 started Sep 25 01:10:10.449572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2cb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=175000000,duration_sec=1373,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:10:10.450349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:10:10.450825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:679 - starting polling. Elapsed:0.005 Sep 25 01:10:10.452266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:10:10.454385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:679 - port information retrieved. Elapsed:0.008 Sep 25 01:10:10.454944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:679 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 25 01:10:12.447860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:680 started Sep 25 01:10:12.450877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2cd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=177000000,duration_sec=1375,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:10:12.451492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:10:12.451890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:680 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:10:13.479231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port b6d5a291-fe8f-4e93-8b5f-7dfa9448f2b4 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:10:13.480378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (b6d5a291-fe8f-4e93-8b5f-7dfa9448f2b4), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:10:14.448868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:681 started Sep 25 01:10:14.452003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2cf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=177000000,duration_sec=1377,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:10:14.452671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:10:14.453109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:681 - starting polling. Elapsed:0.004 Sep 25 01:10:14.454621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:10:14.456057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:681 - port information retrieved. Elapsed:0.007 Sep 25 01:10:14.456395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:681 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 25 01:10:15.541754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port b6d5a291-fe8f-4e93-8b5f-7dfa9448f2b4 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:10:15.542887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (b6d5a291-fe8f-4e93-8b5f-7dfa9448f2b4), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:10:16.450291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:682 started Sep 25 01:10:16.452940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2d1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=179000000,duration_sec=1379,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:10:16.453582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:10:16.453935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:682 - starting polling. Elapsed:0.004 Sep 25 01:10:16.455223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:10:16.456773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:682 - port information retrieved. Elapsed:0.007 Sep 25 01:10:16.457137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:682 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 01:10:18.450885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:683 started Sep 25 01:10:18.453688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2d3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=179000000,duration_sec=1381,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:10:18.454289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:10:18.454656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:683 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:10:20.452334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:684 started Sep 25 01:10:20.455376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2d5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=181000000,duration_sec=1383,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:10:20.456176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:10:20.456689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:684 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:10:22.453703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:685 started Sep 25 01:10:22.458209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2d7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=182000000,duration_sec=1385,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:10:22.459770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:10:22.460753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:685 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 01:10:24.454637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:686 started Sep 25 01:10:24.457352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2d9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=183000000,duration_sec=1387,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:10:24.457977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:10:24.458339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:686 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:10:26.455190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:687 started Sep 25 01:10:26.457642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2db,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=183000000,duration_sec=1389,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:10:26.458475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:10:26.459193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:687 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:10:28.456518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:688 started Sep 25 01:10:28.459438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2dd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=185000000,duration_sec=1391,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:10:28.460230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:10:28.460642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:688 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:10:30.457756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:689 started Sep 25 01:10:30.460485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2df,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=186000000,duration_sec=1393,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:10:30.461079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:10:30.461518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:689 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:10:32.459288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:690 started Sep 25 01:10:32.465156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2e1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=188000000,duration_sec=1395,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:10:32.466288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:10:32.466915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:690 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 25 01:10:34.460353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:691 started Sep 25 01:10:34.463343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2e3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=189000000,duration_sec=1397,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:10:34.463995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:10:34.464353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:691 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:10:36.462354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:692 started Sep 25 01:10:36.464511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2e5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=190000000,duration_sec=1399,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:10:36.465153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:10:36.465558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:692 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:10:38.462584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:693 started Sep 25 01:10:38.465744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2e7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=191000000,duration_sec=1401,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:10:38.466404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:10:38.466799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:693 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:10:40.463850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:694 started Sep 25 01:10:40.467913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2e9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=192000000,duration_sec=1403,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:10:40.468661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:10:40.469109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:694 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:10:42.464673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:695 started Sep 25 01:10:42.467413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2eb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=193000000,duration_sec=1405,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:10:42.468170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:10:42.468651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:695 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:10:44.465622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:696 started Sep 25 01:10:44.468357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2ed,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=194000000,duration_sec=1407,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:10:44.468945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:10:44.469327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:696 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:10:46.466997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:697 started Sep 25 01:10:46.469758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2ef,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=195000000,duration_sec=1409,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:10:46.470416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:10:46.470837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:697 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:10:48.468436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:698 started Sep 25 01:10:48.470936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2f1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=197000000,duration_sec=1411,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:10:48.471523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:10:48.471889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:698 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:10:50.469487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:699 started Sep 25 01:10:50.472356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2f3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=198000000,duration_sec=1413,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:10:50.472959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:10:50.473364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:699 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:10:52.470050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:700 started Sep 25 01:10:52.472771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2f5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=198000000,duration_sec=1415,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:10:52.473390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:10:52.473751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:700 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:10:54.470708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:701 started Sep 25 01:10:54.473291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2f7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=199000000,duration_sec=1417,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:10:54.473902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:10:54.474261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:701 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:10:56.471444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:702 started Sep 25 01:10:56.474148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2f9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=200000000,duration_sec=1419,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:10:56.474746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:10:56.475105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:702 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:10:58.472746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:703 started Sep 25 01:10:58.477768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2fb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=202000000,duration_sec=1421,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:10:58.481144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:10:58.482752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:703 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 25 01:11:00.473459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:704 started Sep 25 01:11:00.476433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2fd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=202000000,duration_sec=1423,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:11:00.478221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:11:00.478653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:704 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:11:02.421686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-7f217a17-9486-47be-ae3a-1edab4fa4cb8 tempest-VolumesSnapshotTestJSON-1338018223 tempest-VolumesSnapshotTestJSON-1338018223-project] Resource Port deleted: b6d5a291-fe8f-4e93-8b5f-7dfa9448f2b4 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:11:02.422735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-7f217a17-9486-47be-ae3a-1edab4fa4cb8 tempest-VolumesSnapshotTestJSON-1338018223 tempest-VolumesSnapshotTestJSON-1338018223-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (b6d5a291-fe8f-4e93-8b5f-7dfa9448f2b4), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:11:02.423003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-7f217a17-9486-47be-ae3a-1edab4fa4cb8 tempest-VolumesSnapshotTestJSON-1338018223 tempest-VolumesSnapshotTestJSON-1338018223-project] Security group member updated {'e519085e-1074-4894-bf01-6cabde2ba0f6'} Sep 25 01:11:02.474287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:705 started Sep 25 01:11:02.479472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e2ff,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=203000000,duration_sec=1425,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:11:02.480142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:11:02.481952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:705 - starting polling. Elapsed:0.007 Sep 25 01:11:02.483542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:11:02.496660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port b6d5a291-fe8f-4e93-8b5f-7dfa9448f2b4 not present in bridge br-int Sep 25 01:11:02.498871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:11:02.500426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['b6d5a291-fe8f-4e93-8b5f-7dfa9448f2b4'] Sep 25 01:11:02.501201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port b6d5a291-fe8f-4e93-8b5f-7dfa9448f2b4 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:11:02.505641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:705 - port information retrieved. Elapsed:0.031 Sep 25 01:11:02.506552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:705 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.032 Sep 25 01:11:04.475449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:706 started Sep 25 01:11:04.478368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e301,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=204000000,duration_sec=1427,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:11:04.478987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:11:04.479350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:706 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:11:06.476483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:707 started Sep 25 01:11:06.481248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e303,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=206000000,duration_sec=1429,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:11:06.482195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:11:06.482731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:707 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 01:11:08.477986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:708 started Sep 25 01:11:08.482944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e305,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=208000000,duration_sec=1431,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:11:08.483903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:11:08.484548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:708 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 25 01:11:10.478647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:709 started Sep 25 01:11:10.481831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e307,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=207000000,duration_sec=1433,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:11:10.483011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:11:10.483443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:709 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:11:12.480147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:710 started Sep 25 01:11:12.484163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e309,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=209000000,duration_sec=1435,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:11:12.485970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:11:12.486608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:710 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:11:14.481087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:711 started Sep 25 01:11:14.485504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e30b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=210000000,duration_sec=1437,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:11:14.486273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:11:14.486770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:711 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:11:14.524061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-995a2fea-91c5-440c-b31b-3704d7ce8390 tempest-VolumesSnapshotTestJSON-1338018223 tempest-VolumesSnapshotTestJSON-1338018223-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-25T01:11:13Z,data_plane_status=None,description='',device_id='578132fa-c1d7-4ce3-a944-cd3c71c8a4e8',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=ac18cb42-0ea0-4b75-a3e1-345296f02558,mac_address=fa:16:3e:42:e0:14,name='',network_id=567e0576-161f-495c-b882-012356a1e499,numa_affinity_policy=,project_id='1f0ea61e4de94ce083c572843a3f09fa',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(ac18cb42-0ea0-4b75-a3e1-345296f02558),security_group_ids=set([e519085e-1074-4894-bf01-6cabde2ba0f6]),status='DOWN',updated_at=2022-09-25T01:11:13Z) {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 25 01:11:14.524703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-995a2fea-91c5-440c-b31b-3704d7ce8390 tempest-VolumesSnapshotTestJSON-1338018223 tempest-VolumesSnapshotTestJSON-1338018223-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (ac18cb42-0ea0-4b75-a3e1-345296f02558), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:11:14.525513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-995a2fea-91c5-440c-b31b-3704d7ce8390 tempest-VolumesSnapshotTestJSON-1338018223 tempest-VolumesSnapshotTestJSON-1338018223-project] Security group member updated {'e519085e-1074-4894-bf01-6cabde2ba0f6'} Sep 25 01:11:15.256862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-10afe7cb-4d80-4d65-9a56-6e90330c6b4e service neutron] Resource Port ac18cb42-0ea0-4b75-a3e1-345296f02558 updated (revision_number 1->2). Old fields: {'device_owner': '', 'bindings': [PortBinding(host='',port_id=ac18cb42-0ea0-4b75-a3e1-345296f02558,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'device_owner': 'compute:nova', 'bindings': [PortBinding(host='hv-cinder-maste',port_id=ac18cb42-0ea0-4b75-a3e1-345296f02558,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:11:15.257248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-10afe7cb-4d80-4d65-9a56-6e90330c6b4e service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (ac18cb42-0ea0-4b75-a3e1-345296f02558), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:11:15.662548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-10afe7cb-4d80-4d65-9a56-6e90330c6b4e service neutron] Resource Port ac18cb42-0ea0-4b75-a3e1-345296f02558 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=ac18cb42-0ea0-4b75-a3e1-345296f02558,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=ac18cb42-0ea0-4b75-a3e1-345296f02558,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=ac18cb42-0ea0-4b75-a3e1-345296f02558,segment=NetworkSegment(91deb3d4-b4f9-46ee-bfd1-a81a7d7214d3),segment_id=91deb3d4-b4f9-46ee-bfd1-a81a7d7214d3)]} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:11:15.663655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-10afe7cb-4d80-4d65-9a56-6e90330c6b4e service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (ac18cb42-0ea0-4b75-a3e1-345296f02558), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:11:16.481804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:712 started Sep 25 01:11:16.484938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e30d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=210000000,duration_sec=1439,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:11:16.485413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:11:16.485803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:712 - starting polling. Elapsed:0.004 Sep 25 01:11:16.487254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:11:16.488621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:712 - port information retrieved. Elapsed:0.007 Sep 25 01:11:16.488993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:712 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 01:11:18.483004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:713 started Sep 25 01:11:18.486399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e30f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=212000000,duration_sec=1441,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:11:18.487021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:11:18.487419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:713 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:11:20.026280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port ac18cb42-0ea0-4b75-a3e1-345296f02558 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:11:20.027035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (ac18cb42-0ea0-4b75-a3e1-345296f02558), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:11:20.483704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:714 started Sep 25 01:11:20.487679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e311,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=212000000,duration_sec=1443,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:11:20.489156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:11:20.490417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:714 - starting polling. Elapsed:0.006 Sep 25 01:11:20.492518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:11:20.495965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:714 - port information retrieved. Elapsed:0.012 Sep 25 01:11:20.496858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:714 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 25 01:11:21.870274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Resource Port ac18cb42-0ea0-4b75-a3e1-345296f02558 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=107261) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 25 01:11:21.871367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-d923fec3-b7d3-40af-bfde-3ff84b588dfa None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-347848'] for Port (ac18cb42-0ea0-4b75-a3e1-345296f02558), after_update {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:11:22.484577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:715 started Sep 25 01:11:22.488000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e313,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=213000000,duration_sec=1445,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:11:22.488820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:11:22.489232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:715 - starting polling. Elapsed:0.005 Sep 25 01:11:22.491279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:11:22.493637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:715 - port information retrieved. Elapsed:0.009 Sep 25 01:11:22.494087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:715 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 25 01:11:24.486036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:716 started Sep 25 01:11:24.490382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e315,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=215000000,duration_sec=1447,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:11:24.492524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:11:24.493365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:716 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 25 01:11:26.486973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:717 started Sep 25 01:11:26.489619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e317,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=215000000,duration_sec=1449,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:11:26.490495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:11:26.490858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:717 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:11:28.487866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:718 started Sep 25 01:11:28.490634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e319,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=216000000,duration_sec=1451,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:11:28.491270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:11:28.491270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:718 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:11:30.488946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:719 started Sep 25 01:11:30.493140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e31b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=218000000,duration_sec=1453,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:11:30.493936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:11:30.494370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:719 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:11:32.489667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:720 started Sep 25 01:11:32.493745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e31d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=219000000,duration_sec=1455,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:11:32.494395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:11:32.494893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:720 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:11:34.490760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:721 started Sep 25 01:11:34.495895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e31f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=220000000,duration_sec=1457,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:11:34.496876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:11:34.497494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:721 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 01:11:36.492397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:722 started Sep 25 01:11:36.495040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e321,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=221000000,duration_sec=1459,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:11:36.495655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:11:36.496013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:722 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:11:38.493296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:723 started Sep 25 01:11:38.495980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e323,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=222000000,duration_sec=1461,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:11:38.496583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:11:38.496936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:723 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:11:40.494176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:724 started Sep 25 01:11:40.496924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e325,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=223000000,duration_sec=1463,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:11:40.497585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:11:40.497946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:724 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:11:42.494699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:725 started Sep 25 01:11:42.497233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e327,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=223000000,duration_sec=1465,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:11:42.497863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:11:42.498395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:725 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:11:44.496070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:726 started Sep 25 01:11:44.502803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e329,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=225000000,duration_sec=1467,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:11:44.503483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:11:44.504015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:726 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 25 01:11:46.497159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:727 started Sep 25 01:11:46.507481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e32b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=226000000,duration_sec=1469,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:11:46.508511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:11:46.509044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:727 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 25 01:11:48.435970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-a53b1266-de64-47c5-a8cd-284cdc21e368 tempest-VolumesSnapshotTestJSON-1338018223 tempest-VolumesSnapshotTestJSON-1338018223-project] Resource Port deleted: ac18cb42-0ea0-4b75-a3e1-345296f02558 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:11:48.437143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-a53b1266-de64-47c5-a8cd-284cdc21e368 tempest-VolumesSnapshotTestJSON-1338018223 tempest-VolumesSnapshotTestJSON-1338018223-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-347825'] for Port (ac18cb42-0ea0-4b75-a3e1-345296f02558), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:11:48.438467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-a53b1266-de64-47c5-a8cd-284cdc21e368 tempest-VolumesSnapshotTestJSON-1338018223 tempest-VolumesSnapshotTestJSON-1338018223-project] Security group member updated {'e519085e-1074-4894-bf01-6cabde2ba0f6'} Sep 25 01:11:48.521467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:728 started Sep 25 01:11:48.532550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e32d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=253000000,duration_sec=1471,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:11:48.534476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:11:48.535355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:728 - starting polling. Elapsed:0.015 Sep 25 01:11:48.537531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-392722'] for ovsdb (None), after_read {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:11:48.538906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.common.ovs_lib [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port ac18cb42-0ea0-4b75-a3e1-345296f02558 not present in bridge br-int Sep 25 01:11:48.539312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] net_uuid None not managed by VLAN manager Sep 25 01:11:48.539638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Remove device filter for ['ac18cb42-0ea0-4b75-a3e1-345296f02558'] Sep 25 01:11:48.539985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Port ac18cb42-0ea0-4b75-a3e1-345296f02558 is not handled by the firewall. {{(pid=107261) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 25 01:11:48.543028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:728 - port information retrieved. Elapsed:0.021 Sep 25 01:11:48.543531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:728 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.023 Sep 25 01:11:50.521516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:729 started Sep 25 01:11:50.525469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e32f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=251000000,duration_sec=1473,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:11:50.526111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:11:50.526543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:729 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:11:52.522456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:730 started Sep 25 01:11:52.525619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e331,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=251000000,duration_sec=1475,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:11:52.526220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:11:52.526578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:730 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:11:54.523434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:731 started Sep 25 01:11:54.527922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e333,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=252000000,duration_sec=1477,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:11:54.528906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:11:54.529525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:731 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:11:56.523927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:732 started Sep 25 01:11:56.526675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e335,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=252000000,duration_sec=1479,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:11:56.527317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:11:56.527747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:732 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:11:58.524915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:733 started Sep 25 01:11:58.527449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e337,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=253000000,duration_sec=1481,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:11:58.528039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:11:58.528406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:733 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:12:00.526150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:734 started Sep 25 01:12:00.530375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e339,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=256000000,duration_sec=1483,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:12:00.531072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:12:00.531514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:734 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:12:02.526643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:735 started Sep 25 01:12:02.529903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e33b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=255000000,duration_sec=1485,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:12:02.530569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:12:02.530993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:735 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:12:04.527436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:736 started Sep 25 01:12:04.531861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e33d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=256000000,duration_sec=1487,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:12:04.532275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:12:04.532488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:736 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:12:06.528838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:737 started Sep 25 01:12:06.531714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e33f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=257000000,duration_sec=1489,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:12:06.532443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:12:06.532931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:737 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:12:08.530253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:738 started Sep 25 01:12:08.533200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e341,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=259000000,duration_sec=1491,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:12:08.533876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:12:08.534444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:738 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:12:10.532019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:739 started Sep 25 01:12:10.535606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e343,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=261000000,duration_sec=1493,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:12:10.536371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:12:10.536911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:739 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:12:12.532858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:740 started Sep 25 01:12:12.535452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e345,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=261000000,duration_sec=1495,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:12:12.536079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:12:12.536510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:740 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:12:13.048491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-718bd820-efb6-40a3-a370-1a92b7624008 admin admin] Resource Subnet deleted: f578e2f2-1d5a-4625-afad-a99b92b56cab {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:12:13.049219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-718bd820-efb6-40a3-a370-1a92b7624008 admin admin] Publish callbacks [] for Subnet (f578e2f2-1d5a-4625-afad-a99b92b56cab), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:12:13.433546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-efa60c33-7988-4461-9674-ec0300493f5e admin admin] Resource Network deleted: 567e0576-161f-495c-b882-012356a1e499 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:12:13.434187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-efa60c33-7988-4461-9674-ec0300493f5e admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-250427'] for Network (567e0576-161f-495c-b882-012356a1e499), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:12:13.751588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f2bc91d3-2c9b-45c2-8976-a79d91551d91 admin admin] Resource SecurityGroup deleted: e519085e-1074-4894-bf01-6cabde2ba0f6 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:12:13.752718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f2bc91d3-2c9b-45c2-8976-a79d91551d91 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-347796'] for SecurityGroup (e519085e-1074-4894-bf01-6cabde2ba0f6), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:12:13.752718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2bc91d3-2c9b-45c2-8976-a79d91551d91 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('e519085e-1074-4894-bf01-6cabde2ba0f6',)}} {{(pid=107261) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 25 01:12:13.772696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f2bc91d3-2c9b-45c2-8976-a79d91551d91 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('e519085e-1074-4894-bf01-6cabde2ba0f6',)))} {{(pid=107261) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 25 01:12:13.773056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f2bc91d3-2c9b-45c2-8976-a79d91551d91 admin admin] Resource SecurityGroupRule deleted: 1ef84868-37b3-4916-b17c-b8facfc1e639 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:12:13.774032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f2bc91d3-2c9b-45c2-8976-a79d91551d91 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (1ef84868-37b3-4916-b17c-b8facfc1e639), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:12:13.774481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f2bc91d3-2c9b-45c2-8976-a79d91551d91 admin admin] Security group rule updated ['e519085e-1074-4894-bf01-6cabde2ba0f6'] Sep 25 01:12:13.775132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f2bc91d3-2c9b-45c2-8976-a79d91551d91 admin admin] Resource SecurityGroupRule deleted: f7ad153a-d6eb-4f12-be99-a745e787b4dc {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:12:13.775651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f2bc91d3-2c9b-45c2-8976-a79d91551d91 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f7ad153a-d6eb-4f12-be99-a745e787b4dc), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:12:13.776133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f2bc91d3-2c9b-45c2-8976-a79d91551d91 admin admin] Security group rule updated ['e519085e-1074-4894-bf01-6cabde2ba0f6'] Sep 25 01:12:13.776608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f2bc91d3-2c9b-45c2-8976-a79d91551d91 admin admin] Resource SecurityGroupRule deleted: f9476ea5-c69f-4b95-a35e-12c822ba443b {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:12:13.777099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f2bc91d3-2c9b-45c2-8976-a79d91551d91 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (f9476ea5-c69f-4b95-a35e-12c822ba443b), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:12:13.777543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f2bc91d3-2c9b-45c2-8976-a79d91551d91 admin admin] Security group rule updated ['e519085e-1074-4894-bf01-6cabde2ba0f6'] Sep 25 01:12:13.778013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.resource_cache [None req-f2bc91d3-2c9b-45c2-8976-a79d91551d91 admin admin] Resource SecurityGroupRule deleted: fc458691-9a76-4498-b17d-23d1d07bc8a1 {{(pid=107261) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 25 01:12:13.778412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron_lib.callbacks.manager [None req-f2bc91d3-2c9b-45c2-8976-a79d91551d91 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-347811'] for SecurityGroupRule (fc458691-9a76-4498-b17d-23d1d07bc8a1), after_delete {{(pid=107261) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 25 01:12:13.779028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.agent.securitygroups_rpc [None req-f2bc91d3-2c9b-45c2-8976-a79d91551d91 admin admin] Security group rule updated ['e519085e-1074-4894-bf01-6cabde2ba0f6'] Sep 25 01:12:14.533599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:741 started Sep 25 01:12:14.536238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e347,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=262000000,duration_sec=1497,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:12:14.536894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:12:14.537962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:741 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:12:16.535367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:742 started Sep 25 01:12:16.539398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e349,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=264000000,duration_sec=1499,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:12:16.540132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:12:16.540587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:742 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:12:18.538358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:743 started Sep 25 01:12:18.541144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e34b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=267000000,duration_sec=1501,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:12:18.541760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:12:18.542117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:743 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:12:20.538290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:744 started Sep 25 01:12:20.542681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e34d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=268000000,duration_sec=1503,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:12:20.543745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:12:20.544431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:744 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:12:22.539519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:745 started Sep 25 01:12:22.542622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e34f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=268000000,duration_sec=1505,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:12:22.543329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:12:22.543783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:745 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:12:24.540824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:746 started Sep 25 01:12:24.543986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e351,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=269000000,duration_sec=1507,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:12:24.544647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:12:24.545042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:746 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:12:26.541586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:747 started Sep 25 01:12:26.544352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e353,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=270000000,duration_sec=1509,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:12:26.544931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:12:26.545309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:747 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:12:28.542191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:748 started Sep 25 01:12:28.544986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e355,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=271000000,duration_sec=1511,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:12:28.545630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:12:28.545982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:748 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:12:30.543199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:749 started Sep 25 01:12:30.545958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e357,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=272000000,duration_sec=1513,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:12:30.546574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:12:30.546997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:749 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:12:32.544119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:750 started Sep 25 01:12:32.546912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e359,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=273000000,duration_sec=1515,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:12:32.547588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:12:32.548023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:750 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:12:34.544948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:751 started Sep 25 01:12:34.552587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e35b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=273000000,duration_sec=1517,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:12:34.553606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:12:34.553999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:751 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 25 01:12:36.546321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:752 started Sep 25 01:12:36.548952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e35d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=275000000,duration_sec=1519,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:12:36.549620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:12:36.550012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:752 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:12:38.547783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:753 started Sep 25 01:12:38.550813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e35f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=277000000,duration_sec=1521,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:12:38.551425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:12:38.551848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:753 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:12:40.548695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:754 started Sep 25 01:12:40.551159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e361,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=277000000,duration_sec=1523,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:12:40.551746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:12:40.552105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:754 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:12:42.549667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:755 started Sep 25 01:12:42.552187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e363,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=278000000,duration_sec=1525,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:12:42.553006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:12:42.553404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:755 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:12:44.550650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:756 started Sep 25 01:12:44.553871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e365,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=279000000,duration_sec=1527,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:12:44.554597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:12:44.555021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:756 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:12:46.552539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:757 started Sep 25 01:12:46.555249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e367,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=281000000,duration_sec=1529,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:12:46.555851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:12:46.556217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:757 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:12:48.553189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:758 started Sep 25 01:12:48.555738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e369,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=281000000,duration_sec=1531,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:12:48.556543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:12:48.556911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:758 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:12:50.554337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:759 started Sep 25 01:12:50.556946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e36b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=283000000,duration_sec=1533,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:12:50.557613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:12:50.558010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:759 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:12:52.555900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:760 started Sep 25 01:12:52.558546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e36d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=284000000,duration_sec=1535,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:12:52.559271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:12:52.559669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:760 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:12:54.556503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:761 started Sep 25 01:12:54.559571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e36f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=285000000,duration_sec=1537,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:12:54.560200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:12:54.560592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:761 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:12:56.557765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:762 started Sep 25 01:12:56.560313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e371,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=286000000,duration_sec=1539,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:12:56.560903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:12:56.561286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:762 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:12:58.558572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:763 started Sep 25 01:12:58.561535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e373,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=287000000,duration_sec=1541,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:12:58.562417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:12:58.562899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:763 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:13:00.559322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:764 started Sep 25 01:13:00.562149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e375,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=288000000,duration_sec=1543,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:13:00.562836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:13:00.563283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:764 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:13:02.560521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:765 started Sep 25 01:13:02.563052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e377,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=289000000,duration_sec=1545,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:13:02.563652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:13:02.564021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:765 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:13:04.561921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:766 started Sep 25 01:13:04.564671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e379,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=290000000,duration_sec=1547,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:13:04.565507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:13:04.565878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:766 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:13:06.563181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:767 started Sep 25 01:13:06.566001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e37b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=292000000,duration_sec=1549,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:13:06.567034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:13:06.567411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:767 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:13:08.564518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:768 started Sep 25 01:13:08.572541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e37d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=293000000,duration_sec=1551,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:13:08.573320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:13:08.573685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:768 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 25 01:13:10.565520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:769 started Sep 25 01:13:10.569353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e37f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=295000000,duration_sec=1553,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:13:10.570057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:13:10.570502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:769 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:13:12.566686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:770 started Sep 25 01:13:12.569747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e381,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=295000000,duration_sec=1555,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:13:12.570584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:13:12.570978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:770 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:13:14.567706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:771 started Sep 25 01:13:14.570168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e383,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=296000000,duration_sec=1557,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:13:14.570769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:13:14.571134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:771 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:13:16.568540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:772 started Sep 25 01:13:16.572805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e385,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=297000000,duration_sec=1559,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:13:16.573790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:13:16.574221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:772 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:13:18.569408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:773 started Sep 25 01:13:18.572255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e387,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=298000000,duration_sec=1561,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:13:18.572829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:13:18.573181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:773 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:13:20.569916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:774 started Sep 25 01:13:20.572506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e389,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=298000000,duration_sec=1563,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:13:20.573075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:13:20.573462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:774 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:13:22.571083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:775 started Sep 25 01:13:22.573909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e38b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=299000000,duration_sec=1565,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:13:22.574748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:13:22.575147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:775 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:13:24.571465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:776 started Sep 25 01:13:24.574595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e38d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=300000000,duration_sec=1567,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:13:24.575364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:13:24.575637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:776 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:13:26.572198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:777 started Sep 25 01:13:26.574710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e38f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=301000000,duration_sec=1569,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:13:26.575299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:13:26.575657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:777 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:13:28.573286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:778 started Sep 25 01:13:28.576130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e391,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=302000000,duration_sec=1571,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:13:28.576750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:13:28.577222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:778 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:13:30.574457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:779 started Sep 25 01:13:30.576947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e393,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=303000000,duration_sec=1573,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:13:30.577571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:13:30.577934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:779 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:13:32.575668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:780 started Sep 25 01:13:32.578242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e395,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=304000000,duration_sec=1575,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:13:32.578867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:13:32.579365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:780 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:13:34.576389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:781 started Sep 25 01:13:34.579088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e397,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=305000000,duration_sec=1577,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:13:34.579711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:13:34.580072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:781 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:13:36.577390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:782 started Sep 25 01:13:36.580838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e399,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=306000000,duration_sec=1579,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:13:36.582073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:13:36.582438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:782 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:13:38.578750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:783 started Sep 25 01:13:38.582269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e39b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=308000000,duration_sec=1581,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:13:38.582871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:13:38.583270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:783 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:13:40.579365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:784 started Sep 25 01:13:40.583714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e39d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=308000000,duration_sec=1583,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:13:40.584420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:13:40.584874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:784 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:13:42.580484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:785 started Sep 25 01:13:42.588895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e39f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=309000000,duration_sec=1585,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:13:42.590088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:13:42.590451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:785 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 25 01:13:44.583145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:786 started Sep 25 01:13:44.587121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3a1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=312000000,duration_sec=1587,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:13:44.588034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:13:44.588605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:786 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 01:13:46.583233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:787 started Sep 25 01:13:46.586347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3a3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=312000000,duration_sec=1589,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:13:46.587019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:13:46.587432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:787 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:13:48.584334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:788 started Sep 25 01:13:48.586706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3a5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=313000000,duration_sec=1591,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:13:48.587289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:13:48.587646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:788 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:13:50.585453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:789 started Sep 25 01:13:50.588289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3a7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=314000000,duration_sec=1593,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:13:50.588937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:13:50.589514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:789 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:13:52.586898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:790 started Sep 25 01:13:52.589846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3a9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=316000000,duration_sec=1595,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:13:52.590434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:13:52.590791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:790 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:13:54.588022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:791 started Sep 25 01:13:54.591426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3ab,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=317000000,duration_sec=1597,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:13:54.592156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:13:54.592661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:791 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:13:56.589277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:792 started Sep 25 01:13:56.592487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3ad,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=318000000,duration_sec=1599,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:13:56.593137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:13:56.593646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:792 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:13:58.590520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:793 started Sep 25 01:13:58.593861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3af,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=319000000,duration_sec=1601,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:13:58.595003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:13:58.595405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:793 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:14:00.591521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:794 started Sep 25 01:14:00.594100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3b1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=320000000,duration_sec=1603,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:14:00.594825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:14:00.595208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:794 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:14:02.592264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:795 started Sep 25 01:14:02.594992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3b3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=321000000,duration_sec=1605,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:14:02.595576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:14:02.595943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:795 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:14:04.593403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:796 started Sep 25 01:14:04.597522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3b5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=322000000,duration_sec=1607,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:14:04.598165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:14:04.598528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:796 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:14:06.593877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:797 started Sep 25 01:14:06.596549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3b7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=322000000,duration_sec=1609,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:14:06.597156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:14:06.597546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:797 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:14:08.595380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:798 started Sep 25 01:14:08.598374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3b9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=324000000,duration_sec=1611,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:14:08.599012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:14:08.599379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:798 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:14:10.595792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:799 started Sep 25 01:14:10.598722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3bb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=324000000,duration_sec=1613,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:14:10.599450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:14:10.599858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:799 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:14:12.597280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:800 started Sep 25 01:14:12.600107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3bd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=326000000,duration_sec=1615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:14:12.600778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:14:12.601236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:800 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:14:14.598176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:801 started Sep 25 01:14:14.600700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3bf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=327000000,duration_sec=1617,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:14:14.601289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:14:14.601649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:801 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:14:16.598880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:802 started Sep 25 01:14:16.607083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3c1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=327000000,duration_sec=1619,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:14:16.607809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:14:16.608172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:802 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 25 01:14:18.599588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:803 started Sep 25 01:14:18.602134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3c3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=328000000,duration_sec=1621,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:14:18.602765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:14:18.603125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:803 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:14:20.600952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:804 started Sep 25 01:14:20.603811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3c5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=330000000,duration_sec=1623,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:14:20.604440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:14:20.604875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:804 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:14:22.603404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:805 started Sep 25 01:14:22.606800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3c7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=332000000,duration_sec=1625,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:14:22.607602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:14:22.608017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:805 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 01:14:24.602639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:806 started Sep 25 01:14:24.605768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3c9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=331000000,duration_sec=1627,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:14:24.606414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:14:24.606813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:806 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:14:26.604079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:807 started Sep 25 01:14:26.606886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3cb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=333000000,duration_sec=1629,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:14:26.607516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:14:26.607915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:807 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:14:28.605602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:808 started Sep 25 01:14:28.608089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3cd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=334000000,duration_sec=1631,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:14:28.608682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:14:28.609047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:808 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:14:30.606171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:809 started Sep 25 01:14:30.609098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3cf,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=335000000,duration_sec=1633,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:14:30.609709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:14:30.610077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:809 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:14:32.607502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:810 started Sep 25 01:14:32.611954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3d1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=336000000,duration_sec=1635,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:14:32.612910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:14:32.613346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:810 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:14:34.608466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:811 started Sep 25 01:14:34.611473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3d3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=337000000,duration_sec=1637,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:14:34.611999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:14:34.612466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:811 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:14:36.609507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:812 started Sep 25 01:14:36.612059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3d5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=338000000,duration_sec=1639,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:14:36.612645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:14:36.613006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:812 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:14:38.611421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:813 started Sep 25 01:14:38.614487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3d7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=340000000,duration_sec=1641,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:14:38.615169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:14:38.615678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:813 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:14:40.611560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:814 started Sep 25 01:14:40.614364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3d9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=340000000,duration_sec=1643,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:14:40.614953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:14:40.615319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:814 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:14:42.612422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:815 started Sep 25 01:14:42.617042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3db,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=342000000,duration_sec=1645,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:14:42.617755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:14:42.618173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:815 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:14:44.613784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:816 started Sep 25 01:14:44.617548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3dd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=343000000,duration_sec=1647,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:14:44.618818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:14:44.619430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:816 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:14:46.614925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:817 started Sep 25 01:14:46.618185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3df,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=343000000,duration_sec=1649,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:14:46.618860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:14:46.619313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:817 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:14:48.615573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:818 started Sep 25 01:14:48.618837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3e1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=345000000,duration_sec=1651,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:14:48.619524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:14:48.619973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:818 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:14:50.616893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:819 started Sep 25 01:14:50.619966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3e3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=346000000,duration_sec=1653,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:14:50.620565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:14:50.620953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:819 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:14:52.617644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:820 started Sep 25 01:14:52.621114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3e5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=346000000,duration_sec=1655,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:14:52.622907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:14:52.622907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:820 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:14:54.618353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:821 started Sep 25 01:14:54.621302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3e7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=347000000,duration_sec=1657,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:14:54.621891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:14:54.622340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:821 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:14:56.619743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:822 started Sep 25 01:14:56.622546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3e9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=348000000,duration_sec=1659,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:14:56.623162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:14:56.623568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:822 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:14:58.620864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:823 started Sep 25 01:14:58.623370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3eb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=349000000,duration_sec=1661,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:14:58.623974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:14:58.624334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:823 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:15:00.621413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:824 started Sep 25 01:15:00.624130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3ed,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=350000000,duration_sec=1663,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:15:00.624773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:15:00.625164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:824 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:15:02.622379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:825 started Sep 25 01:15:02.626515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3ef,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=351000000,duration_sec=1665,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:15:02.627187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:15:02.627656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:825 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:15:04.623828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:826 started Sep 25 01:15:04.627637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3f1,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=352000000,duration_sec=1667,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:15:04.628409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:15:04.628893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:826 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:15:06.624357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:827 started Sep 25 01:15:06.627120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3f3,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=353000000,duration_sec=1669,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:15:06.627709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:15:06.628067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:827 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:15:08.625699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:828 started Sep 25 01:15:08.628844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3f5,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=354000000,duration_sec=1671,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:15:08.629763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:15:08.630222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:828 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:15:10.627036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:829 started Sep 25 01:15:10.629670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3f7,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=355000000,duration_sec=1673,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:15:10.630263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:15:10.630612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:829 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:15:12.628158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:830 started Sep 25 01:15:12.630727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3f9,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=356000000,duration_sec=1675,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:15:12.631311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:15:12.631685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:830 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:15:14.629527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:831 started Sep 25 01:15:14.632436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3fb,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=358000000,duration_sec=1677,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:15:14.633063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:15:14.633560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:831 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:15:16.630319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:832 started Sep 25 01:15:16.633025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3fd,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=359000000,duration_sec=1679,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:15:16.633674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:15:16.634065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:832 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:15:18.631290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:833 started Sep 25 01:15:18.633960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e3ff,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=360000000,duration_sec=1681,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:15:18.634656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:15:18.635090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:833 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:15:20.632635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:834 started Sep 25 01:15:20.635384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e401,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=361000000,duration_sec=1683,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:15:20.636022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:15:20.636419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:834 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:15:22.633087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:835 started Sep 25 01:15:22.635793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e403,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=362000000,duration_sec=1685,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:15:22.636455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:15:22.636884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:835 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:15:24.634707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:836 started Sep 25 01:15:24.638258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e405,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=364000000,duration_sec=1687,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:15:24.638895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:15:24.639291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:836 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:15:26.635158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:837 started Sep 25 01:15:26.638564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e407,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=364000000,duration_sec=1689,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:15:26.639251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:15:26.639638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:837 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:15:28.636202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:838 started Sep 25 01:15:28.638875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e409,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=365000000,duration_sec=1691,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:15:28.640443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:15:28.640916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:838 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:15:30.636758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:839 started Sep 25 01:15:30.639418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e40b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=365000000,duration_sec=1693,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:15:30.640248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:15:30.640857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:839 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:15:32.637716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:840 started Sep 25 01:15:32.640276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e40d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=366000000,duration_sec=1695,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:15:32.640871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:15:32.641225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:840 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:15:34.639086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:841 started Sep 25 01:15:34.641682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e40f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=367000000,duration_sec=1697,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:15:34.642387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:15:34.642774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:841 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:15:36.640886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:842 started Sep 25 01:15:36.644466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e411,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=370000000,duration_sec=1699,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:15:36.645229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:15:36.645752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:842 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:15:38.641814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:843 started Sep 25 01:15:38.644312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e413,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=370000000,duration_sec=1701,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:15:38.645040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:15:38.645470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:843 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:15:40.642889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:844 started Sep 25 01:15:40.645753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e415,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=371000000,duration_sec=1703,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:15:40.646606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:15:40.647003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:844 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:15:42.644256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:845 started Sep 25 01:15:42.647210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e417,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=373000000,duration_sec=1705,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:15:42.648033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:15:42.648478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:845 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:15:44.645426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:846 started Sep 25 01:15:44.648142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e419,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=374000000,duration_sec=1707,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:15:44.648800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:15:44.649250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:846 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:15:46.646419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:847 started Sep 25 01:15:46.649159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e41b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=375000000,duration_sec=1709,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:15:46.649862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:15:46.650256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:847 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:15:48.647219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:848 started Sep 25 01:15:48.650380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e41d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=376000000,duration_sec=1711,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:15:48.651015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:15:48.651375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:848 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:15:50.648263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:849 started Sep 25 01:15:50.656390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e41f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=377000000,duration_sec=1713,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:15:50.657683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:15:50.658083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:849 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 25 01:15:52.649410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:850 started Sep 25 01:15:52.651997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e421,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=378000000,duration_sec=1715,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:15:52.652584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:15:52.652980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:850 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:15:54.650643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:851 started Sep 25 01:15:54.653398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e423,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=379000000,duration_sec=1717,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:15:54.654052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:15:54.654500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:851 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:15:56.651918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:852 started Sep 25 01:15:56.655311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e425,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=381000000,duration_sec=1719,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:15:56.655906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:15:56.656258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:852 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:15:58.652808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:853 started Sep 25 01:15:58.655311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e427,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=381000000,duration_sec=1721,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:15:58.656028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:15:58.656424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:853 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:16:00.653714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:854 started Sep 25 01:16:00.656948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e429,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=383000000,duration_sec=1723,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:16:00.657554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:16:00.657906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:854 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:16:02.655377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:855 started Sep 25 01:16:02.658418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e42b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=384000000,duration_sec=1725,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:16:02.659042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:16:02.659398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:855 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:16:04.656197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:856 started Sep 25 01:16:04.658690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e42d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=384000000,duration_sec=1727,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:16:04.659305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:16:04.659759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:856 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:16:06.656832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:857 started Sep 25 01:16:06.663022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e42f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=386000000,duration_sec=1729,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:16:06.663656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:16:06.664008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:857 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 25 01:16:08.658095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:858 started Sep 25 01:16:08.660559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e431,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=386000000,duration_sec=1731,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:16:08.661183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:16:08.661623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:858 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:16:10.658862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:859 started Sep 25 01:16:10.661638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e433,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=387000000,duration_sec=1733,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:16:10.662265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:16:10.662656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:859 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:16:12.659610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:860 started Sep 25 01:16:12.662332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e435,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=388000000,duration_sec=1735,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:16:12.662933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:16:12.663320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:860 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:16:14.660822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:861 started Sep 25 01:16:14.669029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e437,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=390000000,duration_sec=1737,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:16:14.670292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:16:14.670654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:861 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 25 01:16:16.661356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:862 started Sep 25 01:16:16.664526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e439,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=390000000,duration_sec=1739,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:16:16.665704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:16:16.666144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:862 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:16:18.662368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:863 started Sep 25 01:16:18.665092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e43b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=391000000,duration_sec=1741,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:16:18.665719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:16:18.666083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:863 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:16:20.662897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:864 started Sep 25 01:16:20.665665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e43d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=391000000,duration_sec=1743,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:16:20.666256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:16:20.666616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:864 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:16:22.664097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:865 started Sep 25 01:16:22.667018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e43f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=393000000,duration_sec=1745,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:16:22.667632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:16:22.668038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:865 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:16:24.665525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:866 started Sep 25 01:16:24.669527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e441,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=394000000,duration_sec=1747,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:16:24.670448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:16:24.671018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:866 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:16:26.666323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:867 started Sep 25 01:16:26.669053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e443,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=395000000,duration_sec=1749,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:16:26.670360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:16:26.670757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:867 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:16:28.667491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:868 started Sep 25 01:16:28.670531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e445,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=396000000,duration_sec=1751,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:16:28.671298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:16:28.671739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:868 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:16:30.668621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:869 started Sep 25 01:16:30.672551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e447,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=398000000,duration_sec=1753,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:16:30.673169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:16:30.673607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:869 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:16:32.670079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:870 started Sep 25 01:16:32.673156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e449,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=398000000,duration_sec=1755,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:16:32.673796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:16:32.674159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:870 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:16:34.671133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:871 started Sep 25 01:16:34.674393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e44b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=400000000,duration_sec=1757,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:16:34.675051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:16:34.675573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:871 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:16:36.672140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:872 started Sep 25 01:16:36.675837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e44d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=402000000,duration_sec=1759,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:16:36.676519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:16:36.677041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:872 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:16:38.673284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:873 started Sep 25 01:16:38.677299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e44f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=402000000,duration_sec=1761,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:16:38.677986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:16:38.678434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:873 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:16:40.674615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:874 started Sep 25 01:16:40.678116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e451,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=403000000,duration_sec=1763,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:16:40.678805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:16:40.679515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:874 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:16:42.675872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:875 started Sep 25 01:16:42.679175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e453,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=404000000,duration_sec=1765,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:16:42.679832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:16:42.680190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:875 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:16:44.676946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:876 started Sep 25 01:16:44.679823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e455,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=405000000,duration_sec=1767,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:16:44.680919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:16:44.681369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:876 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:16:46.677968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:877 started Sep 25 01:16:46.681123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e457,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=406000000,duration_sec=1769,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:16:46.681761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:16:46.682121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:877 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:16:48.678626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:878 started Sep 25 01:16:48.687380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e459,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=407000000,duration_sec=1771,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:16:48.688348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:16:48.688713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:878 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 25 01:16:50.679515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:879 started Sep 25 01:16:50.682166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e45b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=408000000,duration_sec=1773,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:16:50.682746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:16:50.683128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:879 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:16:52.680544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:880 started Sep 25 01:16:52.683714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e45d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=409000000,duration_sec=1775,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:16:52.684463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:16:52.684957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:880 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:16:54.682041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:881 started Sep 25 01:16:54.685880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e45f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=411000000,duration_sec=1777,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:16:54.686552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:16:54.686946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:881 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:16:56.682945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:882 started Sep 25 01:16:56.686120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e461,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=411000000,duration_sec=1779,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:16:56.686757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:16:56.687151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:882 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:16:58.684073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:883 started Sep 25 01:16:58.687742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e463,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=413000000,duration_sec=1781,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:16:58.688392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:16:58.688810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:883 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:17:00.685043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:884 started Sep 25 01:17:00.687762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e465,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=414000000,duration_sec=1783,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:17:00.688404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:17:00.688796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:884 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:17:02.686041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:885 started Sep 25 01:17:02.689527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e467,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=415000000,duration_sec=1785,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:17:02.690361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:17:02.690858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:885 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:17:04.687385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:886 started Sep 25 01:17:04.690031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e469,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=416000000,duration_sec=1787,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:17:04.690676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:17:04.691075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:886 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:17:06.688877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:887 started Sep 25 01:17:06.692022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e46b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=418000000,duration_sec=1789,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:17:06.692617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:17:06.692977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:887 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:17:08.689236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:888 started Sep 25 01:17:08.692209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e46d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=418000000,duration_sec=1791,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:17:08.692799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:17:08.693157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:888 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:17:10.690773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:889 started Sep 25 01:17:10.693649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e46f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=419000000,duration_sec=1793,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:17:10.694331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:17:10.694730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:889 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:17:12.691953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:890 started Sep 25 01:17:12.695006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e471,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=421000000,duration_sec=1795,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:17:12.695694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:17:12.696132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:890 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:17:14.693098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:891 started Sep 25 01:17:14.696156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e473,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=422000000,duration_sec=1797,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:17:14.696837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:17:14.697314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:891 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:17:16.694687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:892 started Sep 25 01:17:16.697295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e475,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=423000000,duration_sec=1799,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:17:16.697922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:17:16.698317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:892 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:17:18.695972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:893 started Sep 25 01:17:18.700354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e477,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=425000000,duration_sec=1801,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:17:18.700953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:17:18.701348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:893 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:17:20.696745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:894 started Sep 25 01:17:20.700825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e479,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=426000000,duration_sec=1803,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:17:20.702081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:17:20.702794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:894 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 25 01:17:22.698061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:895 started Sep 25 01:17:22.701311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e47b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=427000000,duration_sec=1805,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:17:22.701887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:17:22.702239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:895 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:17:24.699127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:896 started Sep 25 01:17:24.701547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e47d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=427000000,duration_sec=1807,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:17:24.702135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:17:24.702494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:896 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:17:26.699561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:897 started Sep 25 01:17:26.702296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e47f,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=428000000,duration_sec=1809,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:17:26.703009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:17:26.703471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:897 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:17:28.700963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:898 started Sep 25 01:17:28.703452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e481,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=429000000,duration_sec=1811,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:17:28.704050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:17:28.704407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:898 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:17:30.701480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:899 started Sep 25 01:17:30.704275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e483,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=430000000,duration_sec=1813,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:17:30.704898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:17:30.705389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:899 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:17:32.703010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:900 started Sep 25 01:17:32.706208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e485,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=432000000,duration_sec=1815,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:17:32.706972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:17:32.707502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:900 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:17:34.703805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:901 started Sep 25 01:17:34.706843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e487,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=433000000,duration_sec=1817,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:17:34.707497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:17:34.707888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:901 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 25 01:17:36.704736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:902 started Sep 25 01:17:36.708424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e489,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=434000000,duration_sec=1819,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:17:36.709304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:17:36.709770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:902 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:17:38.706175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:903 started Sep 25 01:17:38.710010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e48b,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=435000000,duration_sec=1821,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:17:38.710693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:17:38.711141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:903 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 25 01:17:40.707492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:904 started Sep 25 01:17:40.710503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x7834e48d,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=5543098084362340806,duration_nsec=436000000,duration_sec=1823,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=107261) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 25 01:17:40.711564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: DEBUG neutron.agent.linux.utils [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 109019. {{(pid=107261) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 25 01:17:40.711927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[107261]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-985a27fa-7452-4c6b-829b-91a3beb67520 None None] Agent rpc_loop - iteration:904 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005